Jul 14 16:23:56.656832 ip-10-0-130-193 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 14 16:23:56.656845 ip-10-0-130-193 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 14 16:23:56.656853 ip-10-0-130-193 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 14 16:23:56.657104 ip-10-0-130-193 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 14 16:24:06.682194 ip-10-0-130-193 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 14 16:24:06.682208 ip-10-0-130-193 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot eaa13132c1f64d6d9e12096797a0b1a5 --
Jul 14 16:26:06.104131 ip-10-0-130-193 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 16:26:06.500706 ip-10-0-130-193 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 16:26:06.500706 ip-10-0-130-193 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 16:26:06.500706 ip-10-0-130-193 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 16:26:06.500706 ip-10-0-130-193 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 16:26:06.501903 ip-10-0-130-193 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 16:26:06.501903 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.500804    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 16:26:06.505451 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505430    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:06.505451 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505450    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:06.505451 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505454    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505458    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505461    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505464    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505467    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505470    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505473    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505476    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505479    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505486    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505489    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505491    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505496    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505498    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505501    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505503    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505506    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505509    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505511    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505514    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:06.505549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505517    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505520    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505523    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505525    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505528    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505533    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505537    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505540    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505543    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505545    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505548    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505551    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505554    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505557    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505560    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505562    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505565    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505568    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505570    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:06.506049 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505573    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505575    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505579    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505581    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505583    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505587    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505589    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505592    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505594    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505597    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505599    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505602    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505604    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505607    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505609    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505614    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505617    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505621    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505624    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:06.506516 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505628    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505632    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505635    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505638    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505640    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505643    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505648    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505650    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505653    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505655    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505658    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505662    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505664    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505667    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505670    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505672    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505675    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505677    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505680    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505682    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:06.507056 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505684    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505687    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505689    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505692    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505694    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505697    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505699    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505702    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505706    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505710    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505712    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505715    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505718    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505720    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505722    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505725    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505728    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505730    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.505733    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:06.507561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506494    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506501    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506506    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506510    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506513    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506517    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506520    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506524    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506526    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506529    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506532    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506534    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506537    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506540    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506543    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506545    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506548    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506550    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506553    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:06.508065 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506555    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506558    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506561    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506564    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506567    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506570    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506573    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506575    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506578    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506580    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506583    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506585    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506588    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506590    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506593    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506596    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506598    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506600    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506603    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506606    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:06.508548 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506608    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506611    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506613    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506616    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506620    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506626    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506629    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506632    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506635    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506637    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506640    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506642    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506645    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506648    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506650    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506653    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506656    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506658    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506661    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:06.509052 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506663    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506666    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506668    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506671    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506674    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506676    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506679    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506682    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506684    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506688    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506692    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506695    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506698    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506702    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506705    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506708    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506711    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506713    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506716    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:06.509518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506719    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506722    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506725    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506727    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506730    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506733    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506735    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506738    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506740    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506742    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506745    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506747    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506750    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506753    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506755    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506758    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506760    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506763    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506765    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506768    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506771    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:06.509998 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.506773    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507217    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507225    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507228    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507232    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507235    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507238    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507244    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507247    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507251    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507254    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507257    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507260    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507262    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507265    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507268    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507270    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507273    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507275    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507277    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:06.510498 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507280    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507283    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507285    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507288    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507290    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507293    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507295    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507298    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507300    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507302    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507305    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507307    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507310    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507312    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507315    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507317    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507320    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507322    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507325    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507329    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:06.510992 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507331    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507334    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507336    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507339    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507342    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507344    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507347    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507350    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507352    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507355    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507357    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507360    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507362    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507365    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507367    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507370    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507374    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507378    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507380    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507384    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:06.511518 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507386    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507390    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507392    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507395    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507398    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507400    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507402    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507405    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507407    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507410    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507412    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507422    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507426    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507429    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507431    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507434    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507436    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507439    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507442    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:06.512070 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507444    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507447    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507449    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507451    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507454    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507458    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507461    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507464    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507467    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507470    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507472    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507475    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507486    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507490    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507493    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507496    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507498    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507501    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507503    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:06.512603 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507505    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.507509    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507585    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507593    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507600    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507606    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507610    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507614    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507619    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507623    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507627    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507630    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507634    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507637    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507640    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507643    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507646    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507649    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507652    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507654    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507659    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507661    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507665    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 16:26:06.513089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507668    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507671    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507675    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507678    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507681    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507684    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507687    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507690    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507693    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507696    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507699    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507703    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507706    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507709    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507713    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507716    2574 flags.go:64] FLAG: --enable-server="true"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507720    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507726    2574 flags.go:64] FLAG: --event-burst="100"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507729    2574 flags.go:64] FLAG: --event-qps="50"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507732    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507735    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507738    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507742    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507745    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507748    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 16:26:06.513638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507751    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507754    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507757    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507760    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507763    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507766    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507768    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507771    2574 flags.go:64] FLAG: --feature-gates=""
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507775    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507794    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507797    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507801    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507804    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507807    2574 flags.go:64] FLAG: --help="false"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507810    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-130-193.ec2.internal"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507813    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507815    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507818    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507821    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507825    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507827    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507832    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507834    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 16:26:06.514296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507837    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507842    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507846    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507849    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507852    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507854    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507857    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507860    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507863    2574 flags.go:64] FLAG: --lock-file=""
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507866    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507868    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507871    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507877    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507880    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507883    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507885    2574 flags.go:64] FLAG: --logging-format="text"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507888    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507891    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507895    2574 flags.go:64] FLAG: --manifest-url=""
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507897    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507902    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507904    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507908    2574 flags.go:64] FLAG: --max-pods="110"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507911    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507914    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 16:26:06.514904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507917    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507920    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507923    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507926    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507929    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507939    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507942    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507945    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507949    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507953    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507959    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507961    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507965    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507967    2574 flags.go:64] FLAG: --port="10250"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507970    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507973    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-098919b351b894e95"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507976    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507979    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507982    2574 flags.go:64] FLAG: --register-node="true"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507985    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507989    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507992    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507994    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.507997    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508001    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 16:26:06.515565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508004    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508006    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508009    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508012    2574 flags.go:64] FLAG: --runonce="false"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508015    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508017    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508020    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508023    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508026    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508029    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508032    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508035    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508038    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508042    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508045    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508049    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508052    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508055    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508058    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508064    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508066    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508069    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508073    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508076    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508079    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 16:26:06.516194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508082    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508085    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508087    2574 flags.go:64] FLAG: --v="2"
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508092    2574 flags.go:64] FLAG: --version="false"
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508096    2574 flags.go:64] FLAG: --vmodule=""
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508099    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508102    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508220    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508225    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508228    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508232    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508235    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508238    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508240    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508243    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508245    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508248    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508251    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508254    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508257    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508260    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:06.516808 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508263    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508268    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508271    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508274    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508277    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508280    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508283    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508286    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508288    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508291    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508293    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508296    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508298    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508302    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508305    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508308    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508311    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508315    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508318    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:06.517331 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508321    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508325    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508328    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508331    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508334    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508337    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508340    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508342    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508344    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508347    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508350    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508352    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508356    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508359    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508363    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508366    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508368    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508371    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508374    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508377    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:06.517819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508379    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508382    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508384    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508387    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508389    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508392    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508394    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508397    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508399    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508401    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508404    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508406    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508409    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508411    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508413    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508416    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508419    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508422    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508424    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508427    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:06.518315 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508429    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508432    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508434    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508436    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508440    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508443    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508446    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508449    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508452    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508454    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508457    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508460    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508462    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508465    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508467    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508470    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508473    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508475    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508478    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508480    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:06.518819 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508483    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508485    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508488    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508490    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508493    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.508495    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.508501    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.515606    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.515626    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.516508    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.516518    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516581    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516588    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516591    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:06.519313 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516595    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516598    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516601    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516604    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516607    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516609    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516612    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516615    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516618    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516623    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516626    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516629    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516632    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516635    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516638    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516640    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516643    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516646    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516650    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:06.519683 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516654    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516657    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516660    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516663    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516665    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516668    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516671    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516674    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516677    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516680    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516682    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516685    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516688    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516691    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516693    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516696    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516698    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516701    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516704    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516707    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:06.520230 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516710    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516713    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516715    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516721    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516725    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516728    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516732    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516735    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516738    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516740    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516743    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516745    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516748    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516750    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516753    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516755    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516758    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516760    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516763    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516766    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:06.520726 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516769    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516771    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516774    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516776    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516791    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516794    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516796    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516799    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516801    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516804    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516807    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516809    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516812    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516815    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516818    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516820    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516824    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516827    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516830    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:06.521260 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516834    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516837    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516840    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516843    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516845    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516848    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516851    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516854    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516856    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516858    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516861    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516864    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516867    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516870    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516873    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516876    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516878    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:06.521886 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.516881    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.516886    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517006    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517011    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517014    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517017    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517019    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517022    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517025    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517028    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517030    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517033    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517035    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517040    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:06.522298 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517043    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517047    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517051    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517054    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517057    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517060    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517063    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517066    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517068    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517071    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517073    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517076    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517078    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517081    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517084    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517086    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517089    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517092    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517094    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:06.522664 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517097    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517099    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517102    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517104    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517106    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517109    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517111    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517114    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517116    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517119    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517121    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517124    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517126    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517129    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517132    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517135    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517137    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517140    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517142    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517145    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:06.523251 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517147    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517150    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517152    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517155    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517157    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517160    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517163    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517165    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517168    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517170    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517172    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517175    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517178    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517180    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517183    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517186    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517189    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517192    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517195    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:06.524091 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517197    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517200    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517202    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517204    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517206    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517209    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517211    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517214    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517217    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517220    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517223    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517226    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517228    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517231    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517233    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517237    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517240    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517243    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517246    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517248    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:06.524647 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517251    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517253    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517256    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517258    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517261    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517264    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517266    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517269    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:06.517271    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.517276    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.517410    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.519629    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.521153    2574 server.go:1019] "Starting client certificate rotation"
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.521284    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 16:26:06.525304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.521347    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 16:26:06.525672 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.523553    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 16:26:06.530335 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.530309    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 16:26:06.544750 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.544715    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 14 16:26:06.546946 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.546930    2574 log.go:25] "Validated CRI v1 image API"
Jul 14 16:26:06.547700 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.547686    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 16:26:06.550239 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.550208    2574 fs.go:135] Filesystem UUIDs: map[06dbfd48-5c17-45ed-982d-6b6916719b9a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ff917219-34ed-4357-8ced-ea36f8fbbab9:/dev/nvme0n1p3]
Jul 14 16:26:06.550318 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.550237    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 16:26:06.555652 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.555501    2574 manager.go:216] Machine: {Timestamp:2026-07-14 16:26:06.554144241 +0000 UTC m=+0.333308167 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3217296 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20624955be3d14bedc155dc861cfb5 SystemUUID:ec206249-55be-3d14-bedc-155dc861cfb5 BootID:eaa13132-c1f6-4d6d-9e12-096797a0b1a5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:c5:17:09:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:c5:17:09:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:a4:15:0a:fd:8f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 16:26:06.555652 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.555627    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 16:26:06.555885 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.555761    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 16:26:06.559397 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.559363    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 16:26:06.559568 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.559404    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-193.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 16:26:06.560723 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.560702    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 16:26:06.560770 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.560738    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 16:26:06.560770 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.560754    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 16:26:06.560770 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.560767    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 16:26:06.561766 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.561753    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 16:26:06.562848 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.562836    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 16:26:06.565659 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.565645    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 16:26:06.565820 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.565809    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 16:26:06.565872 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.565845    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 16:26:06.565872 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.565860    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 16:26:06.565943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.565882    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 16:26:06.565943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.565909    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 14 16:26:06.565943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.565932    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 16:26:06.566476 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.566464    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 16:26:06.566525 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.566486    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 16:26:06.568661 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.568640    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 16:26:06.570056 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570035    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 16:26:06.570126 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570071    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 16:26:06.570737 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570722    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 16:26:06.570824 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570742    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 16:26:06.570824 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570750    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 16:26:06.570824 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570757    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 16:26:06.570824 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570768    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 16:26:06.570824 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570775    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 16:26:06.571014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570897    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 16:26:06.571014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570905    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 16:26:06.571014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570912    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 16:26:06.571014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570917    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 16:26:06.571014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570927    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 16:26:06.571014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.570942    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 16:26:06.572403 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.572389    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 16:26:06.572403 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.572405    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 16:26:06.576341 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.576324    2574 server.go:1268] "Started kubelet"
Jul 14 16:26:06.576450 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.576406    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 16:26:06.577150 ip-10-0-130-193 systemd[1]: Started Kubernetes Kubelet.
Jul 14 16:26:06.579641 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.579589    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 16:26:06.579735 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.579671    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 16:26:06.580451 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.580400    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 16:26:06.580746 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.580725    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-193.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 16:26:06.580898 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.580871    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-193.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 16:26:06.581101 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.581082    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 16:26:06.582292 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.582266    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 16:26:06.585238 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.585218    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 16:26:06.585343 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.585238    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 16:26:06.585343 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.585317    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 16:26:06.585437 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.585360    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:06.585765 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.584768    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-193.ec2.internal.18c234b7d6998b7e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-193.ec2.internal,UID:ip-10-0-130-193.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-193.ec2.internal,},FirstTimestamp:2026-07-14 16:26:06.57618419 +0000 UTC m=+0.355348118,LastTimestamp:2026-07-14 16:26:06.57618419 +0000 UTC m=+0.355348118,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-193.ec2.internal,}"
Jul 14 16:26:06.585930 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.585773    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 16:26:06.585930 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.585811    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 16:26:06.585930 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.585832    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 16:26:06.585930 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.585873    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 16:26:06.585930 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.585882    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 16:26:06.586753 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.586735    2574 factory.go:55] Registering systemd factory
Jul 14 16:26:06.586837 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.586758    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 14 16:26:06.586988 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.586977    2574 factory.go:153] Registering CRI-O factory
Jul 14 16:26:06.587043 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.586992    2574 factory.go:223] Registration of the crio container factory successfully
Jul 14 16:26:06.587043 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.587035    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 16:26:06.587141 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.587055    2574 factory.go:103] Registering Raw factory
Jul 14 16:26:06.587141 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.587067    2574 manager.go:1196] Started watching for new ooms in manager
Jul 14 16:26:06.587446 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.587433    2574 manager.go:349] Starting recovery of all containers
Jul 14 16:26:06.594714 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.594678    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 16:26:06.596097 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.595909    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-193.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 16:26:06.599042 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.599021    2574 manager.go:354] Recovery completed
Jul 14 16:26:06.599042 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.599030    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lqjgw"
Jul 14 16:26:06.603653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.603640    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:06.605802 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.605771    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:06.605883 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.605818    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:06.605883 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.605830    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:06.606357 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.606344    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 16:26:06.606357 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.606356    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 16:26:06.606444 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.606371    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 16:26:06.606444 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.606349    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:06.607074 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.607059    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:06.607137 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.607092    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:06.607137 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.607105    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:06.607620 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.607608    2574 policy_none.go:49] "None policy: Start"
Jul 14 16:26:06.607673 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.607625    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 16:26:06.607673 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.607635    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 16:26:06.607951 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.607882    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-193.ec2.internal.18c234b7d85d8045  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-193.ec2.internal,UID:ip-10-0-130-193.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-193.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-193.ec2.internal,},FirstTimestamp:2026-07-14 16:26:06.605803589 +0000 UTC m=+0.384967521,LastTimestamp:2026-07-14 16:26:06.605803589 +0000 UTC m=+0.384967521,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-193.ec2.internal,}"
Jul 14 16:26:06.608720 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.608709    2574 policy_none.go:47] "Start"
Jul 14 16:26:06.609014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.609001    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lqjgw"
Jul 14 16:26:06.651548 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.651523    2574 manager.go:337] "Starting Device Plugin manager"
Jul 14 16:26:06.651708 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.651564    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 16:26:06.651708 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.651574    2574 server.go:87] "Starting device plugin registration server"
Jul 14 16:26:06.651938 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.651923    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 16:26:06.651973 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.651942    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 16:26:06.652053 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.652023    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 16:26:06.652147 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.652115    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 16:26:06.652147 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.652130    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 16:26:06.652702 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.652684    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 16:26:06.652811 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.652741    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:06.748363 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.748318    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 16:26:06.749654 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.749622    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 16:26:06.749749 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.749667    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 16:26:06.749749 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.749691    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 16:26:06.749749 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.749728    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 16:26:06.752460 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.752402    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:06.753059 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.753032    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:06.753262 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.753246    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:06.753313 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.753279    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:06.753313 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.753291    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:06.753398 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.753315    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-193.ec2.internal"
Jul 14 16:26:06.763311 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.763283    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-193.ec2.internal"
Jul 14 16:26:06.763311 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.763316    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-193.ec2.internal\": node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:06.784152 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.784122    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:06.850095 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.850035    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal"]
Jul 14 16:26:06.850252 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.850146    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:06.852116 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.852095    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:06.852254 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.852127    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:06.852254 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.852139    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:06.853401 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.853388    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:06.853552 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.853535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:06.853596 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.853573    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:06.854272 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.854252    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:06.854379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.854275    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:06.854379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.854290    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:06.854379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.854296    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:06.854379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.854303    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:06.854379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.854307    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:06.855523 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.855507    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:06.855618 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.855535    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:06.856342 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.856326    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:06.856424 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.856353    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:06.856424 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.856362    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:06.877504 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.877476    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-193.ec2.internal\" not found" node="ip-10-0-130-193.ec2.internal"
Jul 14 16:26:06.881726 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.881708    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-193.ec2.internal\" not found" node="ip-10-0-130-193.ec2.internal"
Jul 14 16:26:06.884761 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.884744    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:06.985070 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:06.985038    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:06.987284 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.987266    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0a654e6493db505ccfbf814b657b501-config\") pod \"kube-apiserver-proxy-ip-10-0-130-193.ec2.internal\" (UID: \"e0a654e6493db505ccfbf814b657b501\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:06.987353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.987292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1710bdf6d7b42664199f161aa59a6f2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal\" (UID: \"1710bdf6d7b42664199f161aa59a6f2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:06.987353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:06.987310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1710bdf6d7b42664199f161aa59a6f2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal\" (UID: \"1710bdf6d7b42664199f161aa59a6f2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.085325 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:07.085280    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:07.087653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.087627    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0a654e6493db505ccfbf814b657b501-config\") pod \"kube-apiserver-proxy-ip-10-0-130-193.ec2.internal\" (UID: \"e0a654e6493db505ccfbf814b657b501\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.087653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.087577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0a654e6493db505ccfbf814b657b501-config\") pod \"kube-apiserver-proxy-ip-10-0-130-193.ec2.internal\" (UID: \"e0a654e6493db505ccfbf814b657b501\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.087763 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.087705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1710bdf6d7b42664199f161aa59a6f2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal\" (UID: \"1710bdf6d7b42664199f161aa59a6f2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.087763 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.087726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1710bdf6d7b42664199f161aa59a6f2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal\" (UID: \"1710bdf6d7b42664199f161aa59a6f2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.087843 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.087771    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1710bdf6d7b42664199f161aa59a6f2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal\" (UID: \"1710bdf6d7b42664199f161aa59a6f2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.087843 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.087828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1710bdf6d7b42664199f161aa59a6f2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal\" (UID: \"1710bdf6d7b42664199f161aa59a6f2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.183364 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.183313    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.184492 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.184466    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.185569 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:07.185546    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:07.287676 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:07.287576    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:07.387935 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:07.387897    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:07.488963 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:07.488916    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:07.520401 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.520357    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 16:26:07.521035 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.520552    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 16:26:07.589024 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:07.588985    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-193.ec2.internal\" not found"
Jul 14 16:26:07.612845 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.612797    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 16:21:06 +0000 UTC" deadline="2028-03-14 19:21:00.208300677 +0000 UTC"
Jul 14 16:26:07.612845 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.612839    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14618h54m52.595466126s"
Jul 14 16:26:07.658471 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:07.658438    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1710bdf6d7b42664199f161aa59a6f2c.slice/crio-6db7b2b95e3e88d9b7ccf78b6903fdfae62c4d426868dbe13f22e7a5cb0e3e7e WatchSource:0}: Error finding container 6db7b2b95e3e88d9b7ccf78b6903fdfae62c4d426868dbe13f22e7a5cb0e3e7e: Status 404 returned error can't find the container with id 6db7b2b95e3e88d9b7ccf78b6903fdfae62c4d426868dbe13f22e7a5cb0e3e7e
Jul 14 16:26:07.663095 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.663073    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:26:07.668368 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.668348    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:07.686517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.686489    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.698010 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.697982    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 16:26:07.700070 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.700055    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal"
Jul 14 16:26:07.711633 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.711614    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 16:26:07.713579 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:07.713554    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a654e6493db505ccfbf814b657b501.slice/crio-d07d0b94cbcf1e3b53818476013e4e9a6b7c7e3863b2ac84cb37a32e92c77995 WatchSource:0}: Error finding container d07d0b94cbcf1e3b53818476013e4e9a6b7c7e3863b2ac84cb37a32e92c77995: Status 404 returned error can't find the container with id d07d0b94cbcf1e3b53818476013e4e9a6b7c7e3863b2ac84cb37a32e92c77995
Jul 14 16:26:07.753745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.753695    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal" event={"ID":"1710bdf6d7b42664199f161aa59a6f2c","Type":"ContainerStarted","Data":"6db7b2b95e3e88d9b7ccf78b6903fdfae62c4d426868dbe13f22e7a5cb0e3e7e"}
Jul 14 16:26:07.754813 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:07.754764    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal" event={"ID":"e0a654e6493db505ccfbf814b657b501","Type":"ContainerStarted","Data":"d07d0b94cbcf1e3b53818476013e4e9a6b7c7e3863b2ac84cb37a32e92c77995"}
Jul 14 16:26:08.061417 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.061247    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:08.177392 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.177356    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:08.567567 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.567281    2574 apiserver.go:52] "Watching apiserver"
Jul 14 16:26:08.574013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.573981    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 16:26:08.574552 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.574521    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-7tb9w","openshift-network-operator/iptables-alerter-qpgs8","kube-system/konnectivity-agent-d5cpr","kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc","openshift-dns/node-resolver-kcrcf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal","openshift-multus/network-metrics-daemon-rjqlc","openshift-ovn-kubernetes/ovnkube-node-gjkcv","kube-system/global-pull-secret-syncer-drncg","openshift-cluster-node-tuning-operator/tuned-dnwg7","openshift-image-registry/node-ca-xhpsb","openshift-multus/multus-additional-cni-plugins-ww29x","openshift-multus/multus-kp6pp"]
Jul 14 16:26:08.577233 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.577208    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.580580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.580166    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 16:26:08.580580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.580334    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 16:26:08.580580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.580345    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 16:26:08.580580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.580355    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 16:26:08.580580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.580341    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 16:26:08.580580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.580477    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z6l4n\""
Jul 14 16:26:08.580970 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.580603    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.582363 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.582338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:08.583228 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.583207    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 16:26:08.583374 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.583256    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 16:26:08.583431 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.583413    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xhczx\""
Jul 14 16:26:08.583482 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.583461    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 16:26:08.584574 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.584546    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:08.584674 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.584660    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 16:26:08.584837 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.584645    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:08.584937 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.584924    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jdmcw\""
Jul 14 16:26:08.585478 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.585454    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 16:26:08.585657 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.585639    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 16:26:08.588967 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.588947    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.591633 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.591230    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 16:26:08.591633 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.591360    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 16:26:08.591633 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.591526    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-txdsf\""
Jul 14 16:26:08.591633 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.591545    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 16:26:08.592511 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.592491    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.594634 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.594607    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.594798 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.594762    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.594904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.594871    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7h5s\" (UniqueName: \"kubernetes.io/projected/b31bf12d-9703-4823-8ec7-52756804b7e8-kube-api-access-x7h5s\") pod \"iptables-alerter-qpgs8\" (UID: \"b31bf12d-9703-4823-8ec7-52756804b7e8\") " pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.594904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.594900    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:08.595075 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.594918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-socket-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.595075 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.594955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-device-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.595075 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.594979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-os-release\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.595075 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b31bf12d-9703-4823-8ec7-52756804b7e8-host-slash\") pod \"iptables-alerter-qpgs8\" (UID: \"b31bf12d-9703-4823-8ec7-52756804b7e8\") " pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.595075 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5476361-a5d4-422f-8293-b5413c4132c6-konnectivity-ca\") pod \"konnectivity-agent-d5cpr\" (UID: \"b5476361-a5d4-422f-8293-b5413c4132c6\") " pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:08.595075 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-sys-fs\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595083    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbf86\" (UniqueName: \"kubernetes.io/projected/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-kube-api-access-mbf86\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnbpx\" (UniqueName: \"kubernetes.io/projected/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-kube-api-access-jnbpx\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595157    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-system-cni-dir\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-cni-binary-copy\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595202    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595274    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b31bf12d-9703-4823-8ec7-52756804b7e8-iptables-alerter-script\") pod \"iptables-alerter-qpgs8\" (UID: \"b31bf12d-9703-4823-8ec7-52756804b7e8\") " pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595309    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5476361-a5d4-422f-8293-b5413c4132c6-agent-certs\") pod \"konnectivity-agent-d5cpr\" (UID: \"b5476361-a5d4-422f-8293-b5413c4132c6\") " pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595369    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-registration-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.595396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595396    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-cnibin\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.596109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595947    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 16:26:08.596109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595989    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xm5sl\""
Jul 14 16:26:08.596109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.595989    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 16:26:08.597048 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.596817    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:08.597048 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.596896    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:08.597048 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.596943    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 16:26:08.597268 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.597172    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jwskw\""
Jul 14 16:26:08.599705 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.599684    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.604912 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.604879    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 16:26:08.605320 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.605297    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 16:26:08.605650 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.605630    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:08.605746 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.605721    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:08.606631 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.606596    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 16:26:08.607107 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.607083    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 16:26:08.607200 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.607130    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 16:26:08.607422 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.607401    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 16:26:08.607492 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.607477    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.607649 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.607628    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4scvj\""
Jul 14 16:26:08.607721 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.607707    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.610659 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.610636    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 16:26:08.610931 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.610914    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 16:26:08.611195 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.611174    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 16:26:08.611275 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.611201    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 16:26:08.611275 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.611213    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-65tdq\""
Jul 14 16:26:08.611435 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.611343    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 16:26:08.611435 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.611377    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ckzh7\""
Jul 14 16:26:08.619618 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.619588    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 16:26:08.628613 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.628557    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8hv6d"
Jul 14 16:26:08.637055 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.637020    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8hv6d"
Jul 14 16:26:08.687635 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.687599    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 16:26:08.696359 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696322    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-run-openvswitch\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.696543 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.696543 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-sys-fs\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.696543 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696433    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnbpx\" (UniqueName: \"kubernetes.io/projected/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-kube-api-access-jnbpx\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.696543 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c44440c0-557e-4b30-b53b-ac9b24668c0a-tmp-dir\") pod \"node-resolver-kcrcf\" (UID: \"c44440c0-557e-4b30-b53b-ac9b24668c0a\") " pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.696543 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-run-netns\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696554    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6xpw\" (UniqueName: \"kubernetes.io/projected/be2eaf0e-e134-4d45-b39e-35af2e639478-kube-api-access-p6xpw\") pod \"node-ca-xhpsb\" (UID: \"be2eaf0e-e134-4d45-b39e-35af2e639478\") " pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-sys-fs\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696588    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-system-cni-dir\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696620    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b31bf12d-9703-4823-8ec7-52756804b7e8-iptables-alerter-script\") pod \"iptables-alerter-qpgs8\" (UID: \"b31bf12d-9703-4823-8ec7-52756804b7e8\") " pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696651    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-cni-dir\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696674    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-sysctl-conf\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696679    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-system-cni-dir\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696696    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-sys\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696720    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7h5s\" (UniqueName: \"kubernetes.io/projected/b31bf12d-9703-4823-8ec7-52756804b7e8-kube-api-access-x7h5s\") pod \"iptables-alerter-qpgs8\" (UID: \"b31bf12d-9703-4823-8ec7-52756804b7e8\") " pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696745    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-kubelet-config\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:08.696809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be2eaf0e-e134-4d45-b39e-35af2e639478-host\") pod \"node-ca-xhpsb\" (UID: \"be2eaf0e-e134-4d45-b39e-35af2e639478\") " pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-socket-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696861    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b31bf12d-9703-4823-8ec7-52756804b7e8-host-slash\") pod \"iptables-alerter-qpgs8\" (UID: \"b31bf12d-9703-4823-8ec7-52756804b7e8\") " pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5476361-a5d4-422f-8293-b5413c4132c6-konnectivity-ca\") pod \"konnectivity-agent-d5cpr\" (UID: \"b5476361-a5d4-422f-8293-b5413c4132c6\") " pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b31bf12d-9703-4823-8ec7-52756804b7e8-host-slash\") pod \"iptables-alerter-qpgs8\" (UID: \"b31bf12d-9703-4823-8ec7-52756804b7e8\") " pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.696991    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-socket-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c44440c0-557e-4b30-b53b-ac9b24668c0a-hosts-file\") pod \"node-resolver-kcrcf\" (UID: \"c44440c0-557e-4b30-b53b-ac9b24668c0a\") " pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697116    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-node-log\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697152    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-log-socket\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697190    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvhgd\" (UniqueName: \"kubernetes.io/projected/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-kube-api-access-rvhgd\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697247    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-var-lib-cni-bin\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697270    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b31bf12d-9703-4823-8ec7-52756804b7e8-iptables-alerter-script\") pod \"iptables-alerter-qpgs8\" (UID: \"b31bf12d-9703-4823-8ec7-52756804b7e8\") " pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.697332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-var-lib-kubelet\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697357    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697398    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-run\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697436    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm92t\" (UniqueName: \"kubernetes.io/projected/c340b4b5-c833-46c4-8b1a-5d690e06beaa-kube-api-access-jm92t\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697451    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5476361-a5d4-422f-8293-b5413c4132c6-konnectivity-ca\") pod \"konnectivity-agent-d5cpr\" (UID: \"b5476361-a5d4-422f-8293-b5413c4132c6\") " pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697462    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-ovnkube-script-lib\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697494    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-run-netns\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-lib-modules\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-tuned\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be2eaf0e-e134-4d45-b39e-35af2e639478-serviceca\") pod \"node-ca-xhpsb\" (UID: \"be2eaf0e-e134-4d45-b39e-35af2e639478\") " pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697571    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-cnibin\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697588    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-run-ovn\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697601    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-daemon-config\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697620    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-modprobe-d\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697637    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-cnibin\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-systemd\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697669    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-systemd-units\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.697747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-ovnkube-config\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-cni-binary-copy\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697735    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-var-lib-cni-multus\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-hostroot\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbf86\" (UniqueName: \"kubernetes.io/projected/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-kube-api-access-mbf86\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697803    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-run-multus-certs\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697826    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-dbus\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-sysconfig\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5476361-a5d4-422f-8293-b5413c4132c6-agent-certs\") pod \"konnectivity-agent-d5cpr\" (UID: \"b5476361-a5d4-422f-8293-b5413c4132c6\") " pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697896    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-slash\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697917    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-cnibin\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697964    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-run-k8s-cni-cncf-io\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697980    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-var-lib-kubelet\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.697995    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698040    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-kubelet\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.698534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698064    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-run-systemd\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-var-lib-openvswitch\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698093    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698136    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krq4g\" (UniqueName: \"kubernetes.io/projected/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-kube-api-access-krq4g\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698171    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c340b4b5-c833-46c4-8b1a-5d690e06beaa-tmp\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-device-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698200    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698230    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-etc-openvswitch\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698264    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-device-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-env-overrides\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698332    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-ovn-node-metrics-cert\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698355    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-conf-dir\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-cni-bin\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-system-cni-dir\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-socket-dir-parent\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-cni-binary-copy\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.699306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmj6p\" (UniqueName: \"kubernetes.io/projected/c44440c0-557e-4b30-b53b-ac9b24668c0a-kube-api-access-xmj6p\") pod \"node-resolver-kcrcf\" (UID: \"c44440c0-557e-4b30-b53b-ac9b24668c0a\") " pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698644    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvkjv\" (UniqueName: \"kubernetes.io/projected/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-kube-api-access-rvkjv\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698670    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-os-release\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-etc-kubernetes\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698716    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-host\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698743    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698768    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-registration-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698810    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-cni-netd\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-kubernetes\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698857    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-sysctl-d\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.698910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-os-release\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.699022    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.699025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-os-release\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.699097    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.699769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.699133    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-registration-dir\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.700390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.699235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.700390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.699380    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.700390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.699660    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-cni-binary-copy\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.701822 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.701798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5476361-a5d4-422f-8293-b5413c4132c6-agent-certs\") pod \"konnectivity-agent-d5cpr\" (UID: \"b5476361-a5d4-422f-8293-b5413c4132c6\") " pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:08.704518 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.704406    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:08.704518 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.704436    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:08.704518 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.704450    2574 projected.go:196] Error preparing data for projected volume kube-api-access-h9lnx for pod openshift-network-diagnostics/network-check-target-7tb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:08.704755 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.704588    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx podName:057b3092-bfd4-45a1-ae32-d0842c97e0e2 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:09.204559852 +0000 UTC m=+2.983723786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h9lnx" (UniqueName: "kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx") pod "network-check-target-7tb9w" (UID: "057b3092-bfd4-45a1-ae32-d0842c97e0e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:08.706057 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.706034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7h5s\" (UniqueName: \"kubernetes.io/projected/b31bf12d-9703-4823-8ec7-52756804b7e8-kube-api-access-x7h5s\") pod \"iptables-alerter-qpgs8\" (UID: \"b31bf12d-9703-4823-8ec7-52756804b7e8\") " pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.706580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.706560    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnbpx\" (UniqueName: \"kubernetes.io/projected/88dada86-a1bb-4b7f-9f1c-9d0166ce6c59-kube-api-access-jnbpx\") pod \"multus-additional-cni-plugins-ww29x\" (UID: \"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59\") " pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.708647 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.708624    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbf86\" (UniqueName: \"kubernetes.io/projected/7f331864-04a8-4f0a-9361-1c4bf1bdd94e-kube-api-access-mbf86\") pod \"aws-ebs-csi-driver-node-qsqtc\" (UID: \"7f331864-04a8-4f0a-9361-1c4bf1bdd94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.722324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.722292    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:08.799295 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799248    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-daemon-config\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.799295 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799298    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-modprobe-d\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-systemd\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799346    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-systemd-units\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799366    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-ovnkube-config\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799386    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-cni-binary-copy\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799406    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-var-lib-cni-multus\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-hostroot\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799464    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-run-multus-certs\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-dbus\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799508    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-sysconfig\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.799530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-slash\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-cnibin\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-run-k8s-cni-cncf-io\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799601    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-var-lib-kubelet\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799657    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-kubelet\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-run-systemd\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-var-lib-openvswitch\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799731    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krq4g\" (UniqueName: \"kubernetes.io/projected/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-kube-api-access-krq4g\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c340b4b5-c833-46c4-8b1a-5d690e06beaa-tmp\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799804    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-etc-openvswitch\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-env-overrides\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799852    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-ovn-node-metrics-cert\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799875    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-conf-dir\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-cni-bin\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799924    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-system-cni-dir\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-socket-dir-parent\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-daemon-config\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmj6p\" (UniqueName: \"kubernetes.io/projected/c44440c0-557e-4b30-b53b-ac9b24668c0a-kube-api-access-xmj6p\") pod \"node-resolver-kcrcf\" (UID: \"c44440c0-557e-4b30-b53b-ac9b24668c0a\") " pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.799999    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvkjv\" (UniqueName: \"kubernetes.io/projected/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-kube-api-access-rvkjv\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-os-release\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-var-lib-kubelet\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-etc-kubernetes\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800065    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-host\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800086    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-cni-netd\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-kubernetes\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800132    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-sysctl-d\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800149    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-modprobe-d\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-run-openvswitch\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800194    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-systemd\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800206    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800229    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-systemd-units\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800235    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c44440c0-557e-4b30-b53b-ac9b24668c0a-tmp-dir\") pod \"node-resolver-kcrcf\" (UID: \"c44440c0-557e-4b30-b53b-ac9b24668c0a\") " pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800260    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-run-netns\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6xpw\" (UniqueName: \"kubernetes.io/projected/be2eaf0e-e134-4d45-b39e-35af2e639478-kube-api-access-p6xpw\") pod \"node-ca-xhpsb\" (UID: \"be2eaf0e-e134-4d45-b39e-35af2e639478\") " pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800317    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-cni-dir\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.800794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-sysctl-conf\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800363    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-sys\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-kubelet-config\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be2eaf0e-e134-4d45-b39e-35af2e639478-host\") pod \"node-ca-xhpsb\" (UID: \"be2eaf0e-e134-4d45-b39e-35af2e639478\") " pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c44440c0-557e-4b30-b53b-ac9b24668c0a-hosts-file\") pod \"node-resolver-kcrcf\" (UID: \"c44440c0-557e-4b30-b53b-ac9b24668c0a\") " pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800464    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-node-log\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-log-socket\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvhgd\" (UniqueName: \"kubernetes.io/projected/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-kube-api-access-rvhgd\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800540    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800564    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-var-lib-cni-bin\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800590    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-var-lib-kubelet\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800643    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-run\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800669    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm92t\" (UniqueName: \"kubernetes.io/projected/c340b4b5-c833-46c4-8b1a-5d690e06beaa-kube-api-access-jm92t\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800697    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-ovnkube-script-lib\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800712    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-ovnkube-config\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-run-netns\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800746    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-lib-modules\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.801517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800769    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-tuned\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800817    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be2eaf0e-e134-4d45-b39e-35af2e639478-serviceca\") pod \"node-ca-xhpsb\" (UID: \"be2eaf0e-e134-4d45-b39e-35af2e639478\") " pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800849    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-run-ovn\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.800943    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-run-ovn\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.801045    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.801112    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs podName:75c0a561-eae4-4b49-a98b-a8b21f4ddfbc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:09.301095118 +0000 UTC m=+3.080259049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs") pod "network-metrics-daemon-rjqlc" (UID: "75c0a561-eae4-4b49-a98b-a8b21f4ddfbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801118    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-cni-binary-copy\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801166    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-run-systemd\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801167    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-var-lib-cni-multus\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801196    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-hostroot\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801208    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-var-lib-openvswitch\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801324    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-dbus\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801356    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-run-multus-certs\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801401    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-sysconfig\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801435    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-slash\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801481    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-cnibin\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801521    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-run-k8s-cni-cncf-io\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801579    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-cni-dir\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.802500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801620    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-etc-openvswitch\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801863    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-etc-kubernetes\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.801984    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-env-overrides\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-host\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802086    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-cni-netd\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-kubernetes\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802241    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-sysctl-d\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802277    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-socket-dir-parent\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-run-openvswitch\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802324    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802331    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-multus-conf-dir\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-system-cni-dir\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802461    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-run-netns\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c44440c0-557e-4b30-b53b-ac9b24668c0a-tmp-dir\") pod \"node-resolver-kcrcf\" (UID: \"c44440c0-557e-4b30-b53b-ac9b24668c0a\") " pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802646    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-cni-bin\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802852    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-os-release\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802900    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-var-lib-kubelet\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802980    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c44440c0-557e-4b30-b53b-ac9b24668c0a-hosts-file\") pod \"node-resolver-kcrcf\" (UID: \"c44440c0-557e-4b30-b53b-ac9b24668c0a\") " pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.803416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.802982    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-sysctl-conf\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803023    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-sys\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803030    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-node-log\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be2eaf0e-e134-4d45-b39e-35af2e639478-host\") pod \"node-ca-xhpsb\" (UID: \"be2eaf0e-e134-4d45-b39e-35af2e639478\") " pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803130    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803172    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-var-lib-cni-bin\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803215    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-kubelet-config\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803261    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-log-socket\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.803293    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803296    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-host-run-netns\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:08.803338    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret podName:c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:09.303322527 +0000 UTC m=+3.082486451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret") pod "global-pull-secret-syncer-drncg" (UID: "c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803501    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-run\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803835    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-ovnkube-script-lib\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803899    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be2eaf0e-e134-4d45-b39e-35af2e639478-serviceca\") pod \"node-ca-xhpsb\" (UID: \"be2eaf0e-e134-4d45-b39e-35af2e639478\") " pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.803957    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c340b4b5-c833-46c4-8b1a-5d690e06beaa-lib-modules\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.804169    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-host-kubelet\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.804324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.804251    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c340b4b5-c833-46c4-8b1a-5d690e06beaa-tmp\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.807945 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.807923    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c340b4b5-c833-46c4-8b1a-5d690e06beaa-etc-tuned\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.808076 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.807979    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-ovn-node-metrics-cert\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.811148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.811105    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvkjv\" (UniqueName: \"kubernetes.io/projected/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-kube-api-access-rvkjv\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:08.811771 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.811746    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm92t\" (UniqueName: \"kubernetes.io/projected/c340b4b5-c833-46c4-8b1a-5d690e06beaa-kube-api-access-jm92t\") pod \"tuned-dnwg7\" (UID: \"c340b4b5-c833-46c4-8b1a-5d690e06beaa\") " pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.812093 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.812067    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krq4g\" (UniqueName: \"kubernetes.io/projected/9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f-kube-api-access-krq4g\") pod \"multus-kp6pp\" (UID: \"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f\") " pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.812416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.812394    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvhgd\" (UniqueName: \"kubernetes.io/projected/3e29fbf2-e96d-464e-b36b-c479e1c8c63f-kube-api-access-rvhgd\") pod \"ovnkube-node-gjkcv\" (UID: \"3e29fbf2-e96d-464e-b36b-c479e1c8c63f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.812900 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.812878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmj6p\" (UniqueName: \"kubernetes.io/projected/c44440c0-557e-4b30-b53b-ac9b24668c0a-kube-api-access-xmj6p\") pod \"node-resolver-kcrcf\" (UID: \"c44440c0-557e-4b30-b53b-ac9b24668c0a\") " pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.813557 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.813534    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6xpw\" (UniqueName: \"kubernetes.io/projected/be2eaf0e-e134-4d45-b39e-35af2e639478-kube-api-access-p6xpw\") pod \"node-ca-xhpsb\" (UID: \"be2eaf0e-e134-4d45-b39e-35af2e639478\") " pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:08.892406 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.892357    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ww29x"
Jul 14 16:26:08.904711 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.904680    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qpgs8"
Jul 14 16:26:08.918652 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.918616    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:08.925587 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.925558    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc"
Jul 14 16:26:08.934434 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.934403    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcrcf"
Jul 14 16:26:08.941473 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.941443    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kp6pp"
Jul 14 16:26:08.948498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.948472    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:08.957478 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.957447    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dnwg7"
Jul 14 16:26:08.964392 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:08.964368    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xhpsb"
Jul 14 16:26:09.304447 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.304414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:09.304447 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.304461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:09.304704 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.304505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:09.304704 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:09.304585    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:09.304704 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:09.304610    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:09.304704 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:09.304656    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret podName:c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:10.304639708 +0000 UTC m=+4.083803622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret") pod "global-pull-secret-syncer-drncg" (UID: "c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:09.304704 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:09.304674    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs podName:75c0a561-eae4-4b49-a98b-a8b21f4ddfbc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:10.30466502 +0000 UTC m=+4.083828934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs") pod "network-metrics-daemon-rjqlc" (UID: "75c0a561-eae4-4b49-a98b-a8b21f4ddfbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:09.304935 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:09.304703    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:09.304935 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:09.304733    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:09.304935 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:09.304746    2574 projected.go:196] Error preparing data for projected volume kube-api-access-h9lnx for pod openshift-network-diagnostics/network-check-target-7tb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:09.304935 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:09.304825    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx podName:057b3092-bfd4-45a1-ae32-d0842c97e0e2 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:10.304807423 +0000 UTC m=+4.083971342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9lnx" (UniqueName: "kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx") pod "network-check-target-7tb9w" (UID: "057b3092-bfd4-45a1-ae32-d0842c97e0e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:09.517120 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:09.517092    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31bf12d_9703_4823_8ec7_52756804b7e8.slice/crio-8237f9e002dab86528970547a4aac8e9e2e2bbfb12ee746de905a824b67e78e7 WatchSource:0}: Error finding container 8237f9e002dab86528970547a4aac8e9e2e2bbfb12ee746de905a824b67e78e7: Status 404 returned error can't find the container with id 8237f9e002dab86528970547a4aac8e9e2e2bbfb12ee746de905a824b67e78e7
Jul 14 16:26:09.518656 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:09.518628    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e29fbf2_e96d_464e_b36b_c479e1c8c63f.slice/crio-4cb02c8e3a420c03e7fdc479647687392a205161d0ff515a8d3879b01d661c77 WatchSource:0}: Error finding container 4cb02c8e3a420c03e7fdc479647687392a205161d0ff515a8d3879b01d661c77: Status 404 returned error can't find the container with id 4cb02c8e3a420c03e7fdc479647687392a205161d0ff515a8d3879b01d661c77
Jul 14 16:26:09.519587 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:09.519562    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44440c0_557e_4b30_b53b_ac9b24668c0a.slice/crio-6617d60d2fd8c2e77ecdaf68fda99b47c5eeb30a08e1e54c6c7d6d0cf7f8706b WatchSource:0}: Error finding container 6617d60d2fd8c2e77ecdaf68fda99b47c5eeb30a08e1e54c6c7d6d0cf7f8706b: Status 404 returned error can't find the container with id 6617d60d2fd8c2e77ecdaf68fda99b47c5eeb30a08e1e54c6c7d6d0cf7f8706b
Jul 14 16:26:09.520381 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:09.520349    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc340b4b5_c833_46c4_8b1a_5d690e06beaa.slice/crio-ed80e52b82f0b88bcfe4418a2e178346125f7ff2eca176d6d653b1cfe55fedd3 WatchSource:0}: Error finding container ed80e52b82f0b88bcfe4418a2e178346125f7ff2eca176d6d653b1cfe55fedd3: Status 404 returned error can't find the container with id ed80e52b82f0b88bcfe4418a2e178346125f7ff2eca176d6d653b1cfe55fedd3
Jul 14 16:26:09.546090 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:09.546054    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f331864_04a8_4f0a_9361_1c4bf1bdd94e.slice/crio-d9fd6769e429387c4118efc96a362d6f3dc9ed15db4704be83403b59d95199f2 WatchSource:0}: Error finding container d9fd6769e429387c4118efc96a362d6f3dc9ed15db4704be83403b59d95199f2: Status 404 returned error can't find the container with id d9fd6769e429387c4118efc96a362d6f3dc9ed15db4704be83403b59d95199f2
Jul 14 16:26:09.555020 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:09.553849    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88dada86_a1bb_4b7f_9f1c_9d0166ce6c59.slice/crio-e853225654c879a1d62a8b370a6c8f275096e402da24fe04f421501bec2355a5 WatchSource:0}: Error finding container e853225654c879a1d62a8b370a6c8f275096e402da24fe04f421501bec2355a5: Status 404 returned error can't find the container with id e853225654c879a1d62a8b370a6c8f275096e402da24fe04f421501bec2355a5
Jul 14 16:26:09.557182 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:09.556758    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2eaf0e_e134_4d45_b39e_35af2e639478.slice/crio-40806eff47c3c2fc22b77f4a3c6ed2014c6abeb449619a80ccb3479ffc242f22 WatchSource:0}: Error finding container 40806eff47c3c2fc22b77f4a3c6ed2014c6abeb449619a80ccb3479ffc242f22: Status 404 returned error can't find the container with id 40806eff47c3c2fc22b77f4a3c6ed2014c6abeb449619a80ccb3479ffc242f22
Jul 14 16:26:09.561728 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:09.561702    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5476361_a5d4_422f_8293_b5413c4132c6.slice/crio-542333ef7db0c8871be8f6371c2e87d43b592255bc6b1d6aa57e148b372b26a6 WatchSource:0}: Error finding container 542333ef7db0c8871be8f6371c2e87d43b592255bc6b1d6aa57e148b372b26a6: Status 404 returned error can't find the container with id 542333ef7db0c8871be8f6371c2e87d43b592255bc6b1d6aa57e148b372b26a6
Jul 14 16:26:09.640385 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.640198    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:21:08 +0000 UTC" deadline="2028-04-07 23:05:51.724650408 +0000 UTC"
Jul 14 16:26:09.640861 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.640388    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15198h39m42.084269015s"
Jul 14 16:26:09.750966 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.750876    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:09.751114 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:09.750982    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:09.759083 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.759052    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal" event={"ID":"e0a654e6493db505ccfbf814b657b501","Type":"ContainerStarted","Data":"dc76a3d7ec38e13737de6749bb20790371a5bdb17b2d2bc2281b23130649d4a4"}
Jul 14 16:26:09.763266 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.763235    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d5cpr" event={"ID":"b5476361-a5d4-422f-8293-b5413c4132c6","Type":"ContainerStarted","Data":"542333ef7db0c8871be8f6371c2e87d43b592255bc6b1d6aa57e148b372b26a6"}
Jul 14 16:26:09.764495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.764464    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kp6pp" event={"ID":"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f","Type":"ContainerStarted","Data":"1b4a01dc602111fdf0be938c0975120c9a7f0e0f10735c8c9d62da50f9d64dbf"}
Jul 14 16:26:09.765602 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.765579    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww29x" event={"ID":"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59","Type":"ContainerStarted","Data":"e853225654c879a1d62a8b370a6c8f275096e402da24fe04f421501bec2355a5"}
Jul 14 16:26:09.766689 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.766664    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc" event={"ID":"7f331864-04a8-4f0a-9361-1c4bf1bdd94e","Type":"ContainerStarted","Data":"d9fd6769e429387c4118efc96a362d6f3dc9ed15db4704be83403b59d95199f2"}
Jul 14 16:26:09.767814 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.767770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerStarted","Data":"4cb02c8e3a420c03e7fdc479647687392a205161d0ff515a8d3879b01d661c77"}
Jul 14 16:26:09.768758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.768738    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcrcf" event={"ID":"c44440c0-557e-4b30-b53b-ac9b24668c0a","Type":"ContainerStarted","Data":"6617d60d2fd8c2e77ecdaf68fda99b47c5eeb30a08e1e54c6c7d6d0cf7f8706b"}
Jul 14 16:26:09.769761 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.769742    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xhpsb" event={"ID":"be2eaf0e-e134-4d45-b39e-35af2e639478","Type":"ContainerStarted","Data":"40806eff47c3c2fc22b77f4a3c6ed2014c6abeb449619a80ccb3479ffc242f22"}
Jul 14 16:26:09.770717 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.770696    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dnwg7" event={"ID":"c340b4b5-c833-46c4-8b1a-5d690e06beaa","Type":"ContainerStarted","Data":"ed80e52b82f0b88bcfe4418a2e178346125f7ff2eca176d6d653b1cfe55fedd3"}
Jul 14 16:26:09.771599 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:09.771579    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qpgs8" event={"ID":"b31bf12d-9703-4823-8ec7-52756804b7e8","Type":"ContainerStarted","Data":"8237f9e002dab86528970547a4aac8e9e2e2bbfb12ee746de905a824b67e78e7"}
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.312078    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.312148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.312192    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.312317    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.312384    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs podName:75c0a561-eae4-4b49-a98b-a8b21f4ddfbc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:12.312364538 +0000 UTC m=+6.091528454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs") pod "network-metrics-daemon-rjqlc" (UID: "75c0a561-eae4-4b49-a98b-a8b21f4ddfbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.312470    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.312483    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.312496    2574 projected.go:196] Error preparing data for projected volume kube-api-access-h9lnx for pod openshift-network-diagnostics/network-check-target-7tb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.312529    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx podName:057b3092-bfd4-45a1-ae32-d0842c97e0e2 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:12.312517831 +0000 UTC m=+6.091681745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9lnx" (UniqueName: "kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx") pod "network-check-target-7tb9w" (UID: "057b3092-bfd4-45a1-ae32-d0842c97e0e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.312588    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:10.312965 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.312620    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret podName:c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:12.312608688 +0000 UTC m=+6.091772605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret") pod "global-pull-secret-syncer-drncg" (UID: "c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:10.640741 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.640596    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:21:08 +0000 UTC" deadline="2028-03-05 16:11:49.557636743 +0000 UTC"
Jul 14 16:26:10.640741 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.640663    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14399h45m38.916977955s"
Jul 14 16:26:10.752922 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.752887    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:10.753107 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.753039    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:10.753488 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.753465    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:10.753591 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:10.753571    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:10.793504 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.793465    2574 generic.go:356] "Generic (PLEG): container finished" podID="1710bdf6d7b42664199f161aa59a6f2c" containerID="4aaa026686be0c92d1b4bfeabebba3e338e03bb9b6ea13e2c220d6a6d8f2c6e6" exitCode=0
Jul 14 16:26:10.794072 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.794045    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal" event={"ID":"1710bdf6d7b42664199f161aa59a6f2c","Type":"ContainerDied","Data":"4aaa026686be0c92d1b4bfeabebba3e338e03bb9b6ea13e2c220d6a6d8f2c6e6"}
Jul 14 16:26:10.814580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:10.814517    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-193.ec2.internal" podStartSLOduration=3.81449456 podStartE2EDuration="3.81449456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:09.777853733 +0000 UTC m=+3.557017668" watchObservedRunningTime="2026-07-14 16:26:10.81449456 +0000 UTC m=+4.593658498"
Jul 14 16:26:11.750474 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:11.750380    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:11.751005 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:11.750509    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:11.807533 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:11.807469    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal" event={"ID":"1710bdf6d7b42664199f161aa59a6f2c","Type":"ContainerStarted","Data":"f4ada8677c445d7500a23f5ca51ef6b5fb376e74f97fa431899bcfb313bbaa51"}
Jul 14 16:26:12.332371 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:12.332329    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:12.332560 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:12.332405    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:12.332560 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:12.332451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:12.332705 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.332647    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:12.332759 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.332716    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret podName:c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:16.332697414 +0000 UTC m=+10.111861330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret") pod "global-pull-secret-syncer-drncg" (UID: "c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:12.333160 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.333142    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:12.333250 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.333197    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs podName:75c0a561-eae4-4b49-a98b-a8b21f4ddfbc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:16.333180939 +0000 UTC m=+10.112344859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs") pod "network-metrics-daemon-rjqlc" (UID: "75c0a561-eae4-4b49-a98b-a8b21f4ddfbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:12.333355 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.333328    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:12.333355 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.333349    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:12.333472 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.333385    2574 projected.go:196] Error preparing data for projected volume kube-api-access-h9lnx for pod openshift-network-diagnostics/network-check-target-7tb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:12.333472 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.333429    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx podName:057b3092-bfd4-45a1-ae32-d0842c97e0e2 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:16.333416026 +0000 UTC m=+10.112579957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9lnx" (UniqueName: "kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx") pod "network-check-target-7tb9w" (UID: "057b3092-bfd4-45a1-ae32-d0842c97e0e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:12.751948 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:12.751912    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:12.752418 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.752067    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:12.752481 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:12.752452    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:12.752564 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:12.752537    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:13.750973 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:13.750932    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:13.751170 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:13.751082    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:14.752373 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:14.752337    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:14.752952 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:14.752483    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:14.752952 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:14.752919    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:14.753060 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:14.753035    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:15.750014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:15.749979    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:15.750202 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:15.750096    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:16.368059 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:16.368023    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:16.368094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:16.368137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.368207    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.368225    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.368231    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.368245    2574 projected.go:196] Error preparing data for projected volume kube-api-access-h9lnx for pod openshift-network-diagnostics/network-check-target-7tb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.368286    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs podName:75c0a561-eae4-4b49-a98b-a8b21f4ddfbc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:24.368265444 +0000 UTC m=+18.147429372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs") pod "network-metrics-daemon-rjqlc" (UID: "75c0a561-eae4-4b49-a98b-a8b21f4ddfbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.368304    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx podName:057b3092-bfd4-45a1-ae32-d0842c97e0e2 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:24.368293691 +0000 UTC m=+18.147457608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9lnx" (UniqueName: "kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx") pod "network-check-target-7tb9w" (UID: "057b3092-bfd4-45a1-ae32-d0842c97e0e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.368324    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:16.368536 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.368350    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret podName:c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:24.368341676 +0000 UTC m=+18.147505590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret") pod "global-pull-secret-syncer-drncg" (UID: "c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:16.751949 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:16.751908    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:16.751949 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:16.751912    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:16.752971 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.752932    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:16.753152 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:16.753088    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:17.751042 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:17.750468    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:17.751042 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:17.750615    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:18.750348 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:18.750310    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:18.750552 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:18.750469    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:18.750915 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:18.750892    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:18.751051 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:18.750985    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:19.750023 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:19.749987    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:19.750498 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:19.750119    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:20.750610 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:20.750559    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:20.751112 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:20.750583    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:20.751112 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:20.750725    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:20.751112 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:20.750902    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:21.750503 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:21.750462    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:21.750705 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:21.750602    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:22.750278 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:22.750236    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:22.750473 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:22.750255    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:22.750473 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:22.750389    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:22.750580 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:22.750489    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:23.750223 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:23.750186    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:23.750691 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:23.750301    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:24.433701 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:24.433641    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:24.433913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:24.433717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:24.433913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:24.433766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:24.434001 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.433917    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:24.434001 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.433936    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:24.434001 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.433950    2574 projected.go:196] Error preparing data for projected volume kube-api-access-h9lnx for pod openshift-network-diagnostics/network-check-target-7tb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:24.434125 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.434014    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx podName:057b3092-bfd4-45a1-ae32-d0842c97e0e2 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:40.433990904 +0000 UTC m=+34.213154821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9lnx" (UniqueName: "kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx") pod "network-check-target-7tb9w" (UID: "057b3092-bfd4-45a1-ae32-d0842c97e0e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:24.434396 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.434382    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:24.434445 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.434426    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret podName:c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:40.434414912 +0000 UTC m=+34.213578826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret") pod "global-pull-secret-syncer-drncg" (UID: "c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:24.434494 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.434484    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:24.434526 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.434517    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs podName:75c0a561-eae4-4b49-a98b-a8b21f4ddfbc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:40.434504491 +0000 UTC m=+34.213668406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs") pod "network-metrics-daemon-rjqlc" (UID: "75c0a561-eae4-4b49-a98b-a8b21f4ddfbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:24.750325 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:24.750286    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:24.750836 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.750428    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:24.750903 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:24.750859    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:24.750989 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:24.750968    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:25.750668 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:25.750630    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:25.751084 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:25.750748    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:26.750813 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:26.750755    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:26.751244 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:26.750768    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:26.751244 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:26.750908    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:26.751244 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:26.750994    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:27.751127 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:27.750609    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:27.751127 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:27.750748    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:28.751176 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.750894    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:28.751710 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:28.751281    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:28.751710 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.750974    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:28.751710 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:28.751594    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:28.846171 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.845963    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d5cpr" event={"ID":"b5476361-a5d4-422f-8293-b5413c4132c6","Type":"ContainerStarted","Data":"cbc12d20b889f8b5623c34c85aabecac330a876f039e6bd77f09fa005b1e7ddf"}
Jul 14 16:26:28.847571 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.847541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww29x" event={"ID":"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59","Type":"ContainerStarted","Data":"9b1ade4e29ad4d8d717ec90ec1aa0d992902eead54bae1b1175055e06b3d900f"}
Jul 14 16:26:28.849234 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.849201    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc" event={"ID":"7f331864-04a8-4f0a-9361-1c4bf1bdd94e","Type":"ContainerStarted","Data":"31bbcb15a1f1fa6241c9506324ef9586dd916f6d1bd0e0a1e8352b601a709a94"}
Jul 14 16:26:28.850887 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.850864    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerStarted","Data":"0431290bef43852eaa43aaec42881868be4f6f5f637455c22e2b8884bb7d003f"}
Jul 14 16:26:28.852114 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.852093    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcrcf" event={"ID":"c44440c0-557e-4b30-b53b-ac9b24668c0a","Type":"ContainerStarted","Data":"23317d819eebf5dea3f1c237329b354f8bf6ac858919199a1ce6f042362d29b8"}
Jul 14 16:26:28.853566 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.853546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xhpsb" event={"ID":"be2eaf0e-e134-4d45-b39e-35af2e639478","Type":"ContainerStarted","Data":"2db6f2ff0d93a33c9d451f0eb1d413a980142294c2951a191a3c8dd49f5523f4"}
Jul 14 16:26:28.854903 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.854884    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dnwg7" event={"ID":"c340b4b5-c833-46c4-8b1a-5d690e06beaa","Type":"ContainerStarted","Data":"8c19f1f2c7f8a284b6cde339681c8bbc4f2c39137807e50829e3a338a4afd7ff"}
Jul 14 16:26:28.862453 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.862409    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-193.ec2.internal" podStartSLOduration=21.862395703 podStartE2EDuration="21.862395703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:11.826251459 +0000 UTC m=+5.605415396" watchObservedRunningTime="2026-07-14 16:26:28.862395703 +0000 UTC m=+22.641559638"
Jul 14 16:26:28.862959 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.862932    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d5cpr" podStartSLOduration=4.059079222 podStartE2EDuration="22.862926676s" totalImagesPullingTime="18.803847454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:28.862261028 +0000 UTC m=+22.641424964" watchObservedRunningTime="2026-07-14 16:26:28.862926676 +0000 UTC m=+22.642090612"
Jul 14 16:26:28.878044 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.877999    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xhpsb" podStartSLOduration=3.939740432 podStartE2EDuration="22.87798373s" totalImagesPullingTime="18.938243298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:28.877659877 +0000 UTC m=+22.656823813" watchObservedRunningTime="2026-07-14 16:26:28.87798373 +0000 UTC m=+22.657147665"
Jul 14 16:26:28.897605 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.897562    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dnwg7" podStartSLOduration=3.908851075 podStartE2EDuration="22.897546918s" totalImagesPullingTime="18.988695843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:28.897072248 +0000 UTC m=+22.676236185" watchObservedRunningTime="2026-07-14 16:26:28.897546918 +0000 UTC m=+22.676710855"
Jul 14 16:26:28.936866 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:28.936690    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kcrcf" podStartSLOduration=3.947712387 podStartE2EDuration="22.936673188s" totalImagesPullingTime="18.988960801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:28.936453544 +0000 UTC m=+22.715617492" watchObservedRunningTime="2026-07-14 16:26:28.936673188 +0000 UTC m=+22.715837124"
Jul 14 16:26:29.144939 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.144907    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:29.242987 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.242957    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:29.750393 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.750360    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:29.750601 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:29.750464    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:29.859039 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.858926    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kp6pp" event={"ID":"9c05bc8b-3c9c-4769-a2dd-56fc801a4c1f","Type":"ContainerStarted","Data":"6ce579634629c246e1fd45755d52949f94837b1115a8bb7c80194f213c3293e0"}
Jul 14 16:26:29.861755 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.861722    2574 generic.go:356] "Generic (PLEG): container finished" podID="88dada86-a1bb-4b7f-9f1c-9d0166ce6c59" containerID="9b1ade4e29ad4d8d717ec90ec1aa0d992902eead54bae1b1175055e06b3d900f" exitCode=0
Jul 14 16:26:29.861913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.861810    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww29x" event={"ID":"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59","Type":"ContainerDied","Data":"9b1ade4e29ad4d8d717ec90ec1aa0d992902eead54bae1b1175055e06b3d900f"}
Jul 14 16:26:29.864745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.864725    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:26:29.865068 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.865046    2574 generic.go:356] "Generic (PLEG): container finished" podID="3e29fbf2-e96d-464e-b36b-c479e1c8c63f" containerID="906d1ad2cdbc0f6b8d358130cef57506309a2a50de9a62297670e432dc9fe1c0" exitCode=1
Jul 14 16:26:29.865162 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.865132    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerStarted","Data":"7e7e24f5aad8bf7c1a26c3d3f878beb49742c9b7c7d1f67983001ef29c6d63da"}
Jul 14 16:26:29.865224 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.865213    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerStarted","Data":"6533667308caf8309420275dd073dcffd62f524760d9d971b499356ea011c8db"}
Jul 14 16:26:29.865285 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.865263    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerStarted","Data":"52fe17d39fd5c520d20e2ac1b63fffd2645a9433460022b668037140b942d501"}
Jul 14 16:26:29.865342 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.865312    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerStarted","Data":"6d7af7e509a25097baad812638053c674410b704cba0d7aa709a67732fc3a21d"}
Jul 14 16:26:29.865391 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.865360    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerDied","Data":"906d1ad2cdbc0f6b8d358130cef57506309a2a50de9a62297670e432dc9fe1c0"}
Jul 14 16:26:29.880636 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:29.880587    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kp6pp" podStartSLOduration=4.639517846 podStartE2EDuration="23.880561375s" totalImagesPullingTime="19.241043529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:29.879769113 +0000 UTC m=+23.658933049" watchObservedRunningTime="2026-07-14 16:26:29.880561375 +0000 UTC m=+23.659725313"
Jul 14 16:26:30.103354 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:30.103301    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:30.174492 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:30.174417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:30.750020 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:30.749975    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:30.750210 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:30.749981    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:30.750210 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:30.750125    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:30.750210 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:30.750184    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:30.868615 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:30.868573    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qpgs8" event={"ID":"b31bf12d-9703-4823-8ec7-52756804b7e8","Type":"ContainerStarted","Data":"866f3ab8c5f888ae245d7cd35567260dc72eb315f2a286c74db54d561f4eba3d"}
Jul 14 16:26:30.887246 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:30.887196    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qpgs8" podStartSLOduration=5.874835045 podStartE2EDuration="24.887180212s" totalImagesPullingTime="19.012345167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:30.886999159 +0000 UTC m=+24.666163096" watchObservedRunningTime="2026-07-14 16:26:30.887180212 +0000 UTC m=+24.666344148"
Jul 14 16:26:31.011125 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.011090    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:31.072415 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.072381    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 16:26:31.111585 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.111547    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:31.669867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.669688    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T16:26:31.072409161Z","UUID":"78622b8c-df41-4aba-bc98-7aa44b4ccc03","Handler":null,"Name":"","Endpoint":""}
Jul 14 16:26:31.671643 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.671450    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 16:26:31.671806 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.671655    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 16:26:31.750684 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.750656    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:31.750890 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:31.750803    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:31.872956 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.872916    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc" event={"ID":"7f331864-04a8-4f0a-9361-1c4bf1bdd94e","Type":"ContainerStarted","Data":"7dce1956b46f14efd3dbc15a158a032c0600e1f633c7f5200a1fde519a7c246f"}
Jul 14 16:26:31.876449 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.876418    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:26:31.876879 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:31.876846    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerStarted","Data":"5c86f84d4794b59e5ecce736923b3d6c35c07f006ab2b9729c4335c9cb6dc11a"}
Jul 14 16:26:32.128233 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:32.128186    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:32.189614 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:32.189576    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:32.750188 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:32.750148    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:32.750390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:32.750195    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:32.750390 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:32.750290    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:32.750473 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:32.750394    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:32.882098 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:32.882063    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc" event={"ID":"7f331864-04a8-4f0a-9361-1c4bf1bdd94e","Type":"ContainerStarted","Data":"84f3c8f921c1137842e863161b97479b967e96029a47c6de58b5c9500059d206"}
Jul 14 16:26:32.902746 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:32.902689    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqtc" podStartSLOduration=4.661362794 podStartE2EDuration="26.902675094s" totalImagesPullingTime="22.2413123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:32.901734139 +0000 UTC m=+26.680898076" watchObservedRunningTime="2026-07-14 16:26:32.902675094 +0000 UTC m=+26.681839029"
Jul 14 16:26:33.479524 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:33.479486    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:33.538332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:33.538287    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:33.538999 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:33.538971    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:33.559942 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:33.559911    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:33.750661 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:33.750621    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:33.750865 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:33.750755    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:33.804323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:33.804286    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:33.804871 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:33.804851    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d5cpr"
Jul 14 16:26:33.879349 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:33.879313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:34.750972 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.750750    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:34.751858 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.750750    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:34.751858 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:34.751054    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:34.751858 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:34.751131    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:34.888514 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.888478    2574 generic.go:356] "Generic (PLEG): container finished" podID="88dada86-a1bb-4b7f-9f1c-9d0166ce6c59" containerID="91be59b284d389c0dc3066d2fa76dfb53525e22fd5bf01dc7cd688c63f4969ee" exitCode=0
Jul 14 16:26:34.888658 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.888552    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww29x" event={"ID":"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59","Type":"ContainerDied","Data":"91be59b284d389c0dc3066d2fa76dfb53525e22fd5bf01dc7cd688c63f4969ee"}
Jul 14 16:26:34.891916 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.891899    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:26:34.892280 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.892250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerStarted","Data":"675bb511e6229e5cc69aaa3ce8e4b7d7560a7e0a73bcaa5b634fe71a995e34e4"}
Jul 14 16:26:34.892667 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.892648    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:34.892757 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.892673    2574 scope.go:117] "RemoveContainer" containerID="906d1ad2cdbc0f6b8d358130cef57506309a2a50de9a62297670e432dc9fe1c0"
Jul 14 16:26:34.892757 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.892720    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:34.910810 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.910772    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:34.993111 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:34.993068    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:35.065344 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:35.065236    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:35.749968 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:35.749928    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:35.750270 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:35.750043    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:35.898927 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:35.898900    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:26:35.899367 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:35.899267    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" event={"ID":"3e29fbf2-e96d-464e-b36b-c479e1c8c63f","Type":"ContainerStarted","Data":"2d2cf5917b272062240e637a2d0d5beb0f44ddd85912e87f0a8a2f0e57e244e9"}
Jul 14 16:26:35.899585 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:35.899561    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:35.915895 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:35.915867    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:26:35.929558 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:35.929498    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv" podStartSLOduration=10.886233549 podStartE2EDuration="29.929475416s" totalImagesPullingTime="19.043241867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:35.929011293 +0000 UTC m=+29.708175229" watchObservedRunningTime="2026-07-14 16:26:35.929475416 +0000 UTC m=+29.708639353"
Jul 14 16:26:36.128375 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.128338    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:36.211511 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.211478    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:36.282979 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.282729    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drncg"]
Jul 14 16:26:36.283117 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.283101    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:36.283210 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:36.283191    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:36.285310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.285287    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rjqlc"]
Jul 14 16:26:36.285419 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.285392    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:36.285487 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:36.285470    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:36.288880 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.288844    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:36.298614 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.298582    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tb9w"]
Jul 14 16:26:36.298751 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.298698    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:36.298805 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:36.298770    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:36.364093 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.363995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:36.904077 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.904036    2574 generic.go:356] "Generic (PLEG): container finished" podID="88dada86-a1bb-4b7f-9f1c-9d0166ce6c59" containerID="01ca258f9fc5d85c70f403ff4841d88ea3a76b7c2aa143fff78ae2492e9ed964" exitCode=0
Jul 14 16:26:36.904657 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:36.904147    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww29x" event={"ID":"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59","Type":"ContainerDied","Data":"01ca258f9fc5d85c70f403ff4841d88ea3a76b7c2aa143fff78ae2492e9ed964"}
Jul 14 16:26:37.750730 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:37.750692    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:37.750903 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:37.750748    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:37.750903 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:37.750716    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:37.750903 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:37.750838    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:37.751025 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:37.750975    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:37.751143 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:37.751115    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:37.909508 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:37.909475    2574 generic.go:356] "Generic (PLEG): container finished" podID="88dada86-a1bb-4b7f-9f1c-9d0166ce6c59" containerID="c6c68077af0457fff2a27ea15d50942145c625d7511111b6428c37706a5fd503" exitCode=0
Jul 14 16:26:37.910097 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:37.909565    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww29x" event={"ID":"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59","Type":"ContainerDied","Data":"c6c68077af0457fff2a27ea15d50942145c625d7511111b6428c37706a5fd503"}
Jul 14 16:26:39.049076 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:39.049036    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:39.119258 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:39.119215    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:39.445972 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:39.445816    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:39.535651 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:39.535610    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:39.635389 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:39.635348    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:39.750075 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:39.750044    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:39.750256 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:39.750044    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:39.750319 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:39.750053    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:39.750319 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:39.750304    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjqlc" podUID="75c0a561-eae4-4b49-a98b-a8b21f4ddfbc"
Jul 14 16:26:39.750400 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:39.750336    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tb9w" podUID="057b3092-bfd4-45a1-ae32-d0842c97e0e2"
Jul 14 16:26:39.750400 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:39.750175    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drncg" podUID="c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22"
Jul 14 16:26:40.392345 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:40.392318    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcrcf_c44440c0-557e-4b30-b53b-ac9b24668c0a/dns-node-resolver/0.log"
Jul 14 16:26:40.454676 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:40.454635    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:40.454676 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:40.454685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:40.454914 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:40.454717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:40.454914 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:40.454816    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:40.454914 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:40.454843    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:40.454914 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:40.454857    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:40.454914 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:40.454865    2574 projected.go:196] Error preparing data for projected volume kube-api-access-h9lnx for pod openshift-network-diagnostics/network-check-target-7tb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:40.454914 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:40.454866    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:40.454914 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:40.454887    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret podName:c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22 nodeName:}" failed. No retries permitted until 2026-07-14 16:27:12.454865401 +0000 UTC m=+66.234029315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret") pod "global-pull-secret-syncer-drncg" (UID: "c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:40.454914 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:40.454906    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx podName:057b3092-bfd4-45a1-ae32-d0842c97e0e2 nodeName:}" failed. No retries permitted until 2026-07-14 16:27:12.454895019 +0000 UTC m=+66.234058932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9lnx" (UniqueName: "kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx") pod "network-check-target-7tb9w" (UID: "057b3092-bfd4-45a1-ae32-d0842c97e0e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:40.454914 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:40.454921    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs podName:75c0a561-eae4-4b49-a98b-a8b21f4ddfbc nodeName:}" failed. No retries permitted until 2026-07-14 16:27:12.454915057 +0000 UTC m=+66.234078971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs") pod "network-metrics-daemon-rjqlc" (UID: "75c0a561-eae4-4b49-a98b-a8b21f4ddfbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:40.638963 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:40.638928    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:40.706359 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:40.706259    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:41.103653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.103556    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:41.198487 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.198450    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:41.350717 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.350665    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:41.386980 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.386899    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xhpsb_be2eaf0e-e134-4d45-b39e-35af2e639478/node-ca/0.log"
Jul 14 16:26:41.444403 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.444360    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:41.594206 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.594178    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-193.ec2.internal" event="NodeReady"
Jul 14 16:26:41.594385 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.594347    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 16:26:41.636007 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.635957    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5569bdfc46-flgsd"]
Jul 14 16:26:41.668999 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.668371    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xlmjp"]
Jul 14 16:26:41.668999 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.668507    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.673449 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.671556    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 16:26:41.673449 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.671686    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-shd8p\""
Jul 14 16:26:41.673449 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.671884    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 16:26:41.673449 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.672348    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 16:26:41.678563 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.678539    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 16:26:41.682006 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.681981    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q898l"]
Jul 14 16:26:41.682130 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.682109    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlmjp"
Jul 14 16:26:41.685737 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.685714    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 16:26:41.685912 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.685717    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s2496\""
Jul 14 16:26:41.685987 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.685923    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 16:26:41.685987 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.685941    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 16:26:41.698204 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.698177    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5569bdfc46-flgsd"]
Jul 14 16:26:41.698364 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.698214    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q898l"]
Jul 14 16:26:41.698364 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.698240    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlmjp"]
Jul 14 16:26:41.698364 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.698260    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4bbms"]
Jul 14 16:26:41.698364 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.698285    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.700695 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.700669    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 16:26:41.700886 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.700863    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 16:26:41.701483 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.701288    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 16:26:41.701483 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.701288    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 16:26:41.701483 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.701379    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mzcgt\""
Jul 14 16:26:41.714569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.714540    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4bbms"]
Jul 14 16:26:41.714753 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.714704    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.717127 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.717106    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s2hf7\""
Jul 14 16:26:41.717419 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.717124    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 16:26:41.717419 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.717356    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 16:26:41.750852 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.750819    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:26:41.751029 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.750893    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:26:41.751029 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.751002    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:26:41.753999 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.753976    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 16:26:41.754432 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.754391    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dnkj4\""
Jul 14 16:26:41.754935 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.754912    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4qnb\""
Jul 14 16:26:41.754935 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.754930    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 16:26:41.755137 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.755113    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 16:26:41.755830 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.755807    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 16:26:41.765243 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765214    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45msf\" (UniqueName: \"kubernetes.io/projected/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-api-access-45msf\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.765381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765258    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.765381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvb4p\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-kube-api-access-tvb4p\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.765469 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765379    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bc128a5-b622-4c08-8f03-4996c20b2e7b-crio-socket\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.765469 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765410    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-installation-pull-secrets\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.765469 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-certificates\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.765567 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bc128a5-b622-4c08-8f03-4996c20b2e7b-data-volume\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.765567 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765498    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-image-registry-private-configuration\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.765567 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-trusted-ca\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.765567 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765548    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5daa139-10d8-4a8c-81ee-c645b18909c4-cert\") pod \"ingress-canary-xlmjp\" (UID: \"a5daa139-10d8-4a8c-81ee-c645b18909c4\") " pod="openshift-ingress-canary/ingress-canary-xlmjp"
Jul 14 16:26:41.765728 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765584    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.765728 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765638    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-bound-sa-token\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.765728 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765697    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdt9q\" (UniqueName: \"kubernetes.io/projected/a5daa139-10d8-4a8c-81ee-c645b18909c4-kube-api-access-vdt9q\") pod \"ingress-canary-xlmjp\" (UID: \"a5daa139-10d8-4a8c-81ee-c645b18909c4\") " pod="openshift-ingress-canary/ingress-canary-xlmjp"
Jul 14 16:26:41.765878 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.765878 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.765847    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-ca-trust-extracted\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.866668 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.866627    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-bound-sa-token\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.866891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.866678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdt9q\" (UniqueName: \"kubernetes.io/projected/a5daa139-10d8-4a8c-81ee-c645b18909c4-kube-api-access-vdt9q\") pod \"ingress-canary-xlmjp\" (UID: \"a5daa139-10d8-4a8c-81ee-c645b18909c4\") " pod="openshift-ingress-canary/ingress-canary-xlmjp"
Jul 14 16:26:41.866891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.866721    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.866891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.866748    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-ca-trust-extracted\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.866891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.866799    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45msf\" (UniqueName: \"kubernetes.io/projected/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-api-access-45msf\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.866891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.866831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.866891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.866860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03790887-ead8-4e3e-b2b5-289fafb70c7c-tmp-dir\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.866891 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:41.866886    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:41.866910    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5569bdfc46-flgsd: secret "image-registry-tls" not found
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.866910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvb4p\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-kube-api-access-tvb4p\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.866948    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bc128a5-b622-4c08-8f03-4996c20b2e7b-crio-socket\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:41.866985    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls podName:2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf nodeName:}" failed. No retries permitted until 2026-07-14 16:26:42.3669635 +0000 UTC m=+36.146127417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls") pod "image-registry-5569bdfc46-flgsd" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf") : secret "image-registry-tls" not found
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-installation-pull-secrets\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867069    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-certificates\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867098    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bc128a5-b622-4c08-8f03-4996c20b2e7b-data-volume\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867138    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qdpw\" (UniqueName: \"kubernetes.io/projected/03790887-ead8-4e3e-b2b5-289fafb70c7c-kube-api-access-8qdpw\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867146    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bc128a5-b622-4c08-8f03-4996c20b2e7b-crio-socket\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867171    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-image-registry-private-configuration\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.867241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867197    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-trusted-ca\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.867738 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867226    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03790887-ead8-4e3e-b2b5-289fafb70c7c-config-volume\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.867738 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5daa139-10d8-4a8c-81ee-c645b18909c4-cert\") pod \"ingress-canary-xlmjp\" (UID: \"a5daa139-10d8-4a8c-81ee-c645b18909c4\") " pod="openshift-ingress-canary/ingress-canary-xlmjp"
Jul 14 16:26:41.867738 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867345    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.867738 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.867738 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867543    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bc128a5-b622-4c08-8f03-4996c20b2e7b-data-volume\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.867738 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.867556    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-ca-trust-extracted\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.867738 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:41.867725    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 16:26:41.868116 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:41.867802    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm podName:9bc128a5-b622-4c08-8f03-4996c20b2e7b nodeName:}" failed. No retries permitted until 2026-07-14 16:26:42.36776947 +0000 UTC m=+36.146933387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q898l" (UID: "9bc128a5-b622-4c08-8f03-4996c20b2e7b") : configmap "kube-rbac-proxy" not found
Jul 14 16:26:41.868116 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:41.867917    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:41.868116 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:41.867956    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls podName:9bc128a5-b622-4c08-8f03-4996c20b2e7b nodeName:}" failed. No retries permitted until 2026-07-14 16:26:42.367944349 +0000 UTC m=+36.147108278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q898l" (UID: "9bc128a5-b622-4c08-8f03-4996c20b2e7b") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:41.868498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.868473    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-certificates\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.868846 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.868825    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-trusted-ca\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.872818 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.872621    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-image-registry-private-configuration\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.872934 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.872692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5daa139-10d8-4a8c-81ee-c645b18909c4-cert\") pod \"ingress-canary-xlmjp\" (UID: \"a5daa139-10d8-4a8c-81ee-c645b18909c4\") " pod="openshift-ingress-canary/ingress-canary-xlmjp"
Jul 14 16:26:41.872934 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.872710    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-installation-pull-secrets\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.885863 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.885831    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvb4p\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-kube-api-access-tvb4p\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.886394 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.886371    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45msf\" (UniqueName: \"kubernetes.io/projected/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-api-access-45msf\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:41.886567 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.886549    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-bound-sa-token\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:41.887855 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.887814    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdt9q\" (UniqueName: \"kubernetes.io/projected/a5daa139-10d8-4a8c-81ee-c645b18909c4-kube-api-access-vdt9q\") pod \"ingress-canary-xlmjp\" (UID: \"a5daa139-10d8-4a8c-81ee-c645b18909c4\") " pod="openshift-ingress-canary/ingress-canary-xlmjp"
Jul 14 16:26:41.890171 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.890140    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:41.968395 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.968264    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qdpw\" (UniqueName: \"kubernetes.io/projected/03790887-ead8-4e3e-b2b5-289fafb70c7c-kube-api-access-8qdpw\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.968395 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.968317    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03790887-ead8-4e3e-b2b5-289fafb70c7c-config-volume\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.968395 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.968346    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.968672 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.968449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03790887-ead8-4e3e-b2b5-289fafb70c7c-tmp-dir\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.968858 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.968837    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03790887-ead8-4e3e-b2b5-289fafb70c7c-tmp-dir\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.968965 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:41.968947    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 16:26:41.969023 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:41.969018    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls podName:03790887-ead8-4e3e-b2b5-289fafb70c7c nodeName:}" failed. No retries permitted until 2026-07-14 16:26:42.468997669 +0000 UTC m=+36.248161603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls") pod "dns-default-4bbms" (UID: "03790887-ead8-4e3e-b2b5-289fafb70c7c") : secret "dns-default-metrics-tls" not found
Jul 14 16:26:41.969078 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.969060    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03790887-ead8-4e3e-b2b5-289fafb70c7c-config-volume\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:41.993317 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.993283    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlmjp"
Jul 14 16:26:41.996293 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:41.996267    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qdpw\" (UniqueName: \"kubernetes.io/projected/03790887-ead8-4e3e-b2b5-289fafb70c7c-kube-api-access-8qdpw\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:42.242001 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.241931    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlmjp"]
Jul 14 16:26:42.308655 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:42.308623    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5daa139_10d8_4a8c_81ee_c645b18909c4.slice/crio-8fe1f2e6db187932b751274780777f329fb39a53a24e44466a5abc31eddc4f9c WatchSource:0}: Error finding container 8fe1f2e6db187932b751274780777f329fb39a53a24e44466a5abc31eddc4f9c: Status 404 returned error can't find the container with id 8fe1f2e6db187932b751274780777f329fb39a53a24e44466a5abc31eddc4f9c
Jul 14 16:26:42.371103 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.371071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:42.371269 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.371114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:42.371269 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:42.371184    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 16:26:42.371269 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:42.371218    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 16:26:42.371269 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:42.371237    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm podName:9bc128a5-b622-4c08-8f03-4996c20b2e7b nodeName:}" failed. No retries permitted until 2026-07-14 16:26:43.371219999 +0000 UTC m=+37.150383914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q898l" (UID: "9bc128a5-b622-4c08-8f03-4996c20b2e7b") : configmap "kube-rbac-proxy" not found
Jul 14 16:26:42.371269 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:42.371238    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5569bdfc46-flgsd: secret "image-registry-tls" not found
Jul 14 16:26:42.371450 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:42.371283    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls podName:2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf nodeName:}" failed. No retries permitted until 2026-07-14 16:26:43.371270583 +0000 UTC m=+37.150434500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls") pod "image-registry-5569bdfc46-flgsd" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf") : secret "image-registry-tls" not found
Jul 14 16:26:42.371450 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.371332    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:42.371450 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:42.371414    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:42.371450 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:42.371444    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls podName:9bc128a5-b622-4c08-8f03-4996c20b2e7b nodeName:}" failed. No retries permitted until 2026-07-14 16:26:43.371436191 +0000 UTC m=+37.150600104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q898l" (UID: "9bc128a5-b622-4c08-8f03-4996c20b2e7b") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:42.471924 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.471895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:42.472307 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:42.472045    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 16:26:42.472307 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:42.472111    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls podName:03790887-ead8-4e3e-b2b5-289fafb70c7c nodeName:}" failed. No retries permitted until 2026-07-14 16:26:43.47209558 +0000 UTC m=+37.251259494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls") pod "dns-default-4bbms" (UID: "03790887-ead8-4e3e-b2b5-289fafb70c7c") : secret "dns-default-metrics-tls" not found
Jul 14 16:26:42.925241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.925162    2574 generic.go:356] "Generic (PLEG): container finished" podID="88dada86-a1bb-4b7f-9f1c-9d0166ce6c59" containerID="f05330c4562f8980fe72f54c40e5212e9424965128eb3c94f9bb3b8e5d3df6e2" exitCode=0
Jul 14 16:26:42.925398 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.925275    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww29x" event={"ID":"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59","Type":"ContainerDied","Data":"f05330c4562f8980fe72f54c40e5212e9424965128eb3c94f9bb3b8e5d3df6e2"}
Jul 14 16:26:42.926545 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.926520    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlmjp" event={"ID":"a5daa139-10d8-4a8c-81ee-c645b18909c4","Type":"ContainerStarted","Data":"8fe1f2e6db187932b751274780777f329fb39a53a24e44466a5abc31eddc4f9c"}
Jul 14 16:26:42.958873 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.958839    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kqxrf"]
Jul 14 16:26:42.981064 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.981026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kqxrf"]
Jul 14 16:26:42.981223 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.981162    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:42.984694 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.983954    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 14 16:26:42.984694 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.984113    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 14 16:26:42.984694 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.984189    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 14 16:26:42.984694 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.983955    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 14 16:26:42.985462 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:42.985438    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tdm6m\""
Jul 14 16:26:43.077380 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.077350    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/45d64755-02cb-4ba0-b806-ebe0d1e46789-signing-cabundle\") pod \"service-ca-79f68b9f4f-kqxrf\" (UID: \"45d64755-02cb-4ba0-b806-ebe0d1e46789\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.077509 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.077408    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89z69\" (UniqueName: \"kubernetes.io/projected/45d64755-02cb-4ba0-b806-ebe0d1e46789-kube-api-access-89z69\") pod \"service-ca-79f68b9f4f-kqxrf\" (UID: \"45d64755-02cb-4ba0-b806-ebe0d1e46789\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.077605 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.077580    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/45d64755-02cb-4ba0-b806-ebe0d1e46789-signing-key\") pod \"service-ca-79f68b9f4f-kqxrf\" (UID: \"45d64755-02cb-4ba0-b806-ebe0d1e46789\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.178463 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.178373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/45d64755-02cb-4ba0-b806-ebe0d1e46789-signing-key\") pod \"service-ca-79f68b9f4f-kqxrf\" (UID: \"45d64755-02cb-4ba0-b806-ebe0d1e46789\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.178636 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.178475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/45d64755-02cb-4ba0-b806-ebe0d1e46789-signing-cabundle\") pod \"service-ca-79f68b9f4f-kqxrf\" (UID: \"45d64755-02cb-4ba0-b806-ebe0d1e46789\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.178636 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.178518    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89z69\" (UniqueName: \"kubernetes.io/projected/45d64755-02cb-4ba0-b806-ebe0d1e46789-kube-api-access-89z69\") pod \"service-ca-79f68b9f4f-kqxrf\" (UID: \"45d64755-02cb-4ba0-b806-ebe0d1e46789\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.179454 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.179418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/45d64755-02cb-4ba0-b806-ebe0d1e46789-signing-cabundle\") pod \"service-ca-79f68b9f4f-kqxrf\" (UID: \"45d64755-02cb-4ba0-b806-ebe0d1e46789\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.182580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.182560    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/45d64755-02cb-4ba0-b806-ebe0d1e46789-signing-key\") pod \"service-ca-79f68b9f4f-kqxrf\" (UID: \"45d64755-02cb-4ba0-b806-ebe0d1e46789\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.188251 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.188222    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89z69\" (UniqueName: \"kubernetes.io/projected/45d64755-02cb-4ba0-b806-ebe0d1e46789-kube-api-access-89z69\") pod \"service-ca-79f68b9f4f-kqxrf\" (UID: \"45d64755-02cb-4ba0-b806-ebe0d1e46789\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.201093 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.201003    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:43.268225 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.268191    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:43.296367 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.296329    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf"
Jul 14 16:26:43.380542 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.380510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:43.380745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.380573    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:43.380745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.380609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:43.380745 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:43.380716    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 16:26:43.381665 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:43.380839    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm podName:9bc128a5-b622-4c08-8f03-4996c20b2e7b nodeName:}" failed. No retries permitted until 2026-07-14 16:26:45.380762494 +0000 UTC m=+39.159926428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q898l" (UID: "9bc128a5-b622-4c08-8f03-4996c20b2e7b") : configmap "kube-rbac-proxy" not found
Jul 14 16:26:43.381665 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:43.380919    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 16:26:43.381665 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:43.380922    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:43.381665 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:43.380935    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5569bdfc46-flgsd: secret "image-registry-tls" not found
Jul 14 16:26:43.381665 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:43.380997    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls podName:9bc128a5-b622-4c08-8f03-4996c20b2e7b nodeName:}" failed. No retries permitted until 2026-07-14 16:26:45.380977265 +0000 UTC m=+39.160141195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q898l" (UID: "9bc128a5-b622-4c08-8f03-4996c20b2e7b") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:43.381665 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:43.381020    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls podName:2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf nodeName:}" failed. No retries permitted until 2026-07-14 16:26:45.381009631 +0000 UTC m=+39.160173549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls") pod "image-registry-5569bdfc46-flgsd" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf") : secret "image-registry-tls" not found
Jul 14 16:26:43.459258 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.459156    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kqxrf"]
Jul 14 16:26:43.464853 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:43.464824    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d64755_02cb_4ba0_b806_ebe0d1e46789.slice/crio-a612828ef71740c0dd004b93fa1351c43c89bbb854f93f7744a0ffc295fc65e1 WatchSource:0}: Error finding container a612828ef71740c0dd004b93fa1351c43c89bbb854f93f7744a0ffc295fc65e1: Status 404 returned error can't find the container with id a612828ef71740c0dd004b93fa1351c43c89bbb854f93f7744a0ffc295fc65e1
Jul 14 16:26:43.481277 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.481246    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:43.481612 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:43.481387    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 16:26:43.481612 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:43.481449    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls podName:03790887-ead8-4e3e-b2b5-289fafb70c7c nodeName:}" failed. No retries permitted until 2026-07-14 16:26:45.481429972 +0000 UTC m=+39.260593885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls") pod "dns-default-4bbms" (UID: "03790887-ead8-4e3e-b2b5-289fafb70c7c") : secret "dns-default-metrics-tls" not found
Jul 14 16:26:43.932116 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.932074    2574 generic.go:356] "Generic (PLEG): container finished" podID="88dada86-a1bb-4b7f-9f1c-9d0166ce6c59" containerID="65442a481e4ba63bc904c95a53113ce981720d6b0f1a2e9e27c87dc54cde2d25" exitCode=0
Jul 14 16:26:43.932300 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.932163    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww29x" event={"ID":"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59","Type":"ContainerDied","Data":"65442a481e4ba63bc904c95a53113ce981720d6b0f1a2e9e27c87dc54cde2d25"}
Jul 14 16:26:43.933342 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:43.933321    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf" event={"ID":"45d64755-02cb-4ba0-b806-ebe0d1e46789","Type":"ContainerStarted","Data":"a612828ef71740c0dd004b93fa1351c43c89bbb854f93f7744a0ffc295fc65e1"}
Jul 14 16:26:44.074410 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:44.074367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:44.940745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:44.940714    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww29x" event={"ID":"88dada86-a1bb-4b7f-9f1c-9d0166ce6c59","Type":"ContainerStarted","Data":"ff5fe52e1fba951073f4f270584abbf8ecd35cfdacb577bfdae3178f5ae98cb8"}
Jul 14 16:26:44.942645 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:44.942615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlmjp" event={"ID":"a5daa139-10d8-4a8c-81ee-c645b18909c4","Type":"ContainerStarted","Data":"decb15c9918889a1c33c2c215c39f6d50b21389817a83217785c63d7b131ac59"}
Jul 14 16:26:44.996353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:44.996235    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ww29x" podStartSLOduration=8.776074418 podStartE2EDuration="38.996214599s" totalImagesPullingTime="30.220140181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:44.996047181 +0000 UTC m=+38.775211117" watchObservedRunningTime="2026-07-14 16:26:44.996214599 +0000 UTC m=+38.775378519"
Jul 14 16:26:45.023867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:45.023798    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xlmjp" podStartSLOduration=1.511511619 podStartE2EDuration="4.02376102s" totalImagesPullingTime="2.512249401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:45.023472549 +0000 UTC m=+38.802636487" watchObservedRunningTime="2026-07-14 16:26:45.02376102 +0000 UTC m=+38.802924957"
Jul 14 16:26:45.396723 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:45.396519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:45.396927 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:45.396744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:45.396927 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:45.396681    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:45.396927 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:45.396776    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:45.396927 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:45.396866    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls podName:9bc128a5-b622-4c08-8f03-4996c20b2e7b nodeName:}" failed. No retries permitted until 2026-07-14 16:26:49.396844145 +0000 UTC m=+43.176008077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q898l" (UID: "9bc128a5-b622-4c08-8f03-4996c20b2e7b") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:45.396927 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:45.396875    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 16:26:45.396927 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:45.396886    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 16:26:45.396927 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:45.396894    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5569bdfc46-flgsd: secret "image-registry-tls" not found
Jul 14 16:26:45.396927 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:45.396932    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm podName:9bc128a5-b622-4c08-8f03-4996c20b2e7b nodeName:}" failed. No retries permitted until 2026-07-14 16:26:49.396921396 +0000 UTC m=+43.176085310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q898l" (UID: "9bc128a5-b622-4c08-8f03-4996c20b2e7b") : configmap "kube-rbac-proxy" not found
Jul 14 16:26:45.397344 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:45.396944    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls podName:2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf nodeName:}" failed. No retries permitted until 2026-07-14 16:26:49.396938692 +0000 UTC m=+43.176102606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls") pod "image-registry-5569bdfc46-flgsd" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf") : secret "image-registry-tls" not found
Jul 14 16:26:45.497650 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:45.497602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:45.497835 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:45.497761    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 16:26:45.497899 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:45.497853    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls podName:03790887-ead8-4e3e-b2b5-289fafb70c7c nodeName:}" failed. No retries permitted until 2026-07-14 16:26:49.497837126 +0000 UTC m=+43.277001040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls") pod "dns-default-4bbms" (UID: "03790887-ead8-4e3e-b2b5-289fafb70c7c") : secret "dns-default-metrics-tls" not found
Jul 14 16:26:45.918230 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:45.918179    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:45.947019 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:45.946904    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf" event={"ID":"45d64755-02cb-4ba0-b806-ebe0d1e46789","Type":"ContainerStarted","Data":"7ca1284ba7202b4ebb2910a228168c60fc8a12d88ff1d5a7df7c60fe52b4afb6"}
Jul 14 16:26:45.964142 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:45.964086    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-kqxrf" podStartSLOduration=1.752178666 podStartE2EDuration="3.964068456s" totalImagesPullingTime="2.21188979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:45.963244341 +0000 UTC m=+39.742408278" watchObservedRunningTime="2026-07-14 16:26:45.964068456 +0000 UTC m=+39.743232392"
Jul 14 16:26:46.688296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:46.688254    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:46.858026 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:46.857990    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:46.958767 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:46.958662    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:47.054244 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:47.054209    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:47.144694 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:47.144663    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:47.318169 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:47.318137    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:47.435364 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:47.435326    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:47.649527 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:47.649431    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:47.755173 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:47.755136    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:48.169673 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:48.169633    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:48.570858 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:48.570823    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:48.755433 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:48.755397    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:49.354358 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:49.354319    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:49.436246 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:49.436204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:49.436465 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:49.436264    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:49.436465 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:49.436365    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:49.436465 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:49.436378    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 16:26:49.436465 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:49.436401    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5569bdfc46-flgsd: secret "image-registry-tls" not found
Jul 14 16:26:49.436465 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:49.436458    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls podName:2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf nodeName:}" failed. No retries permitted until 2026-07-14 16:26:57.436437142 +0000 UTC m=+51.215601058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls") pod "image-registry-5569bdfc46-flgsd" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf") : secret "image-registry-tls" not found
Jul 14 16:26:49.436670 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:49.436469    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:49.436670 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:49.436520    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls podName:9bc128a5-b622-4c08-8f03-4996c20b2e7b nodeName:}" failed. No retries permitted until 2026-07-14 16:26:57.436504837 +0000 UTC m=+51.215668751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q898l" (UID: "9bc128a5-b622-4c08-8f03-4996c20b2e7b") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:26:49.437032 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:49.437009    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bc128a5-b622-4c08-8f03-4996c20b2e7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:49.536979 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:49.536936    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:49.537153 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:49.537096    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 16:26:49.537194 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:26:49.537166    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls podName:03790887-ead8-4e3e-b2b5-289fafb70c7c nodeName:}" failed. No retries permitted until 2026-07-14 16:26:57.537148248 +0000 UTC m=+51.316312162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls") pod "dns-default-4bbms" (UID: "03790887-ead8-4e3e-b2b5-289fafb70c7c") : secret "dns-default-metrics-tls" not found
Jul 14 16:26:49.750370 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:49.750335    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:49.946460 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:49.946418    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:50.276142 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:50.276103    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:50.378457 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:50.378414    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:50.451800 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:50.451730    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:50.652174 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:50.652076    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:50.790599 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:50.790553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:50.958298 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:50.958192    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:51.032313 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:51.032278    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:51.347199 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:51.347163    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:51.405007 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:51.404973    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:51.748796 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:51.748764    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:52.154356 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:52.154262    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:52.256935 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:52.256894    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:52.354754 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:52.354720    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:52.455466 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:52.455351    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:52.858249 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:52.858205    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:52.957037 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:52.956991    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:53.354336 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:53.354297    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:53.552453 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:53.552419    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:54.153950 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:54.153910    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:54.752022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:54.751989    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:54.949084 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:54.949003    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:55.363041 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:55.362999    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:55.557095 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:55.557055    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:55.998894 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:55.998853    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:56.142974 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:56.142935    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:56.363894 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:56.363797    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:56.979009 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:56.978969    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:57.347677 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.347641    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:57.502415 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.502379    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:57.502592 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.502430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:57.506082 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.506055    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bc128a5-b622-4c08-8f03-4996c20b2e7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q898l\" (UID: \"9bc128a5-b622-4c08-8f03-4996c20b2e7b\") " pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:57.506220 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.506202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") pod \"image-registry-5569bdfc46-flgsd\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") " pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:57.555758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.555723    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:57.580728 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.580690    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:57.603181 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.602824    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:57.605281 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.605259    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03790887-ead8-4e3e-b2b5-289fafb70c7c-metrics-tls\") pod \"dns-default-4bbms\" (UID: \"03790887-ead8-4e3e-b2b5-289fafb70c7c\") " pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:57.609230 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.609201    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q898l"
Jul 14 16:26:57.625417 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.625376    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4bbms"
Jul 14 16:26:57.762662 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.762599    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:57.784839 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.784775    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5569bdfc46-flgsd"]
Jul 14 16:26:57.805358 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.805327    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q898l"]
Jul 14 16:26:57.806591 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:57.806520    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5a79b7_74ab_49a2_bac1_1b4f4cf54ccf.slice/crio-d6996c3ce9fc9adeff7ce8d71a5ec984c8ef5f9003c790691d7d73b91c0592e6 WatchSource:0}: Error finding container d6996c3ce9fc9adeff7ce8d71a5ec984c8ef5f9003c790691d7d73b91c0592e6: Status 404 returned error can't find the container with id d6996c3ce9fc9adeff7ce8d71a5ec984c8ef5f9003c790691d7d73b91c0592e6
Jul 14 16:26:57.808734 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:57.808710    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc128a5_b622_4c08_8f03_4996c20b2e7b.slice/crio-a028daf9b29967b1e08712ad9e5e6ee5239d166b5029844a9c9cb89e50436d8d WatchSource:0}: Error finding container a028daf9b29967b1e08712ad9e5e6ee5239d166b5029844a9c9cb89e50436d8d: Status 404 returned error can't find the container with id a028daf9b29967b1e08712ad9e5e6ee5239d166b5029844a9c9cb89e50436d8d
Jul 14 16:26:57.828417 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.828386    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4bbms"]
Jul 14 16:26:57.831549 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:26:57.831520    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03790887_ead8_4e3e_b2b5_289fafb70c7c.slice/crio-89ecf6f65cd106f285cff2007c3a3db21586c6906b620f54a7f47cb1a24a813b WatchSource:0}: Error finding container 89ecf6f65cd106f285cff2007c3a3db21586c6906b620f54a7f47cb1a24a813b: Status 404 returned error can't find the container with id 89ecf6f65cd106f285cff2007c3a3db21586c6906b620f54a7f47cb1a24a813b
Jul 14 16:26:57.977201 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.977164    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4bbms" event={"ID":"03790887-ead8-4e3e-b2b5-289fafb70c7c","Type":"ContainerStarted","Data":"89ecf6f65cd106f285cff2007c3a3db21586c6906b620f54a7f47cb1a24a813b"}
Jul 14 16:26:57.978288 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.978260    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q898l" event={"ID":"9bc128a5-b622-4c08-8f03-4996c20b2e7b","Type":"ContainerStarted","Data":"a028daf9b29967b1e08712ad9e5e6ee5239d166b5029844a9c9cb89e50436d8d"}
Jul 14 16:26:57.979725 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.979703    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd" event={"ID":"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf","Type":"ContainerStarted","Data":"8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112"}
Jul 14 16:26:57.979827 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.979741    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd" event={"ID":"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf","Type":"ContainerStarted","Data":"d6996c3ce9fc9adeff7ce8d71a5ec984c8ef5f9003c790691d7d73b91c0592e6"}
Jul 14 16:26:57.979867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:57.979839    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:26:58.005725 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:26:58.005669    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd" podStartSLOduration=52.005653873 podStartE2EDuration="52.005653873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:58.004356417 +0000 UTC m=+51.783520345" watchObservedRunningTime="2026-07-14 16:26:58.005653873 +0000 UTC m=+51.784817808"
Jul 14 16:27:02.222712 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:02.222677    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:02.305685 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:02.305647    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:02.996541 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:02.996450    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4bbms" event={"ID":"03790887-ead8-4e3e-b2b5-289fafb70c7c","Type":"ContainerStarted","Data":"b0975f68cd4a248d1bd1d129c73dc60cecf04cf730c1031e2716c582374fc56e"}
Jul 14 16:27:02.996541 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:02.996508    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4bbms" event={"ID":"03790887-ead8-4e3e-b2b5-289fafb70c7c","Type":"ContainerStarted","Data":"aecd73bb205e2e91d96b7793a175419a431823557319555efeaf7b6fdb5542b8"}
Jul 14 16:27:02.996738 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:02.996547    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4bbms"
Jul 14 16:27:02.998379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:02.998344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q898l" event={"ID":"9bc128a5-b622-4c08-8f03-4996c20b2e7b","Type":"ContainerStarted","Data":"96e01dccb24a1a18218c8ce505f638093657c33c4069ea4abb0bab2bb8de0441"}
Jul 14 16:27:02.998504 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:02.998392    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q898l" event={"ID":"9bc128a5-b622-4c08-8f03-4996c20b2e7b","Type":"ContainerStarted","Data":"74949512d7b269d11b47d1a10205381b8b894967b27bd3676bac6f6cef067eac"}
Jul 14 16:27:03.016597 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:03.016544    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4bbms" podStartSLOduration=17.74148263 podStartE2EDuration="22.016522436s" totalImagesPullingTime="4.275039806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:03.015720389 +0000 UTC m=+56.794884324" watchObservedRunningTime="2026-07-14 16:27:03.016522436 +0000 UTC m=+56.795686373"
Jul 14 16:27:03.401060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:03.401016    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:04.427538 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.427498    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"]
Jul 14 16:27:04.431256 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.431209    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.432150 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.432120    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"]
Jul 14 16:27:04.437546 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.436498    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"]
Jul 14 16:27:04.437546 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.436603    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"
Jul 14 16:27:04.438775 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.438744    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 16:27:04.439104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.438882    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 16:27:04.439943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.439594    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 14 16:27:04.439943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.439633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.440322 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.440296    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6wnxs\""
Jul 14 16:27:04.440579 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.440561    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 14 16:27:04.444865 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.444847    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 14 16:27:04.445432 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.445414    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 14 16:27:04.445737 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.445719    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 14 16:27:04.445836 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.445801    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 14 16:27:04.447047 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.447028    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 16:27:04.451192 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.451118    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"]
Jul 14 16:27:04.451686 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.451639    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"]
Jul 14 16:27:04.460836 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.460687    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27ss6\" (UniqueName: \"kubernetes.io/projected/e343ae58-7bbf-47cc-b199-e4c0728b4787-kube-api-access-27ss6\") pod \"managed-serviceaccount-addon-agent-7bfcc494b8-xktgc\" (UID: \"e343ae58-7bbf-47cc-b199-e4c0728b4787\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"
Jul 14 16:27:04.460836 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.460737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/168e9a0a-5f42-4030-b573-7f653fb4c514-klusterlet-config\") pod \"klusterlet-addon-workmgr-5949bf46f-krrnj\" (UID: \"168e9a0a-5f42-4030-b573-7f653fb4c514\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.462675 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.461228    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.462840 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.462765    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5569bdfc46-flgsd"]
Jul 14 16:27:04.463013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.462950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168e9a0a-5f42-4030-b573-7f653fb4c514-tmp\") pod \"klusterlet-addon-workmgr-5949bf46f-krrnj\" (UID: \"168e9a0a-5f42-4030-b573-7f653fb4c514\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.463013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.462993    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-ca\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.463169 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.463039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.463169 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.463096    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgj2n\" (UniqueName: \"kubernetes.io/projected/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-kube-api-access-jgj2n\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.463169 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.463123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cm9m\" (UniqueName: \"kubernetes.io/projected/168e9a0a-5f42-4030-b573-7f653fb4c514-kube-api-access-7cm9m\") pod \"klusterlet-addon-workmgr-5949bf46f-krrnj\" (UID: \"168e9a0a-5f42-4030-b573-7f653fb4c514\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.463169 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.463151    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e343ae58-7bbf-47cc-b199-e4c0728b4787-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bfcc494b8-xktgc\" (UID: \"e343ae58-7bbf-47cc-b199-e4c0728b4787\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"
Jul 14 16:27:04.463312 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.463196    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.463312 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.463223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-hub\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.463871 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.463845    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"]
Jul 14 16:27:04.549922 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.549885    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-847bc8d77b-4vvlh"]
Jul 14 16:27:04.554510 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.554479    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.563841 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.563809    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27ss6\" (UniqueName: \"kubernetes.io/projected/e343ae58-7bbf-47cc-b199-e4c0728b4787-kube-api-access-27ss6\") pod \"managed-serviceaccount-addon-agent-7bfcc494b8-xktgc\" (UID: \"e343ae58-7bbf-47cc-b199-e4c0728b4787\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"
Jul 14 16:27:04.564013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.563858    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/168e9a0a-5f42-4030-b573-7f653fb4c514-klusterlet-config\") pod \"klusterlet-addon-workmgr-5949bf46f-krrnj\" (UID: \"168e9a0a-5f42-4030-b573-7f653fb4c514\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.564013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.563902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.564013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.563920    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168e9a0a-5f42-4030-b573-7f653fb4c514-tmp\") pod \"klusterlet-addon-workmgr-5949bf46f-krrnj\" (UID: \"168e9a0a-5f42-4030-b573-7f653fb4c514\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.564013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.563936    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-ca\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.564013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.563970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.564013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.564012    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgj2n\" (UniqueName: \"kubernetes.io/projected/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-kube-api-access-jgj2n\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.564305 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.564039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cm9m\" (UniqueName: \"kubernetes.io/projected/168e9a0a-5f42-4030-b573-7f653fb4c514-kube-api-access-7cm9m\") pod \"klusterlet-addon-workmgr-5949bf46f-krrnj\" (UID: \"168e9a0a-5f42-4030-b573-7f653fb4c514\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.564305 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.564061    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e343ae58-7bbf-47cc-b199-e4c0728b4787-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bfcc494b8-xktgc\" (UID: \"e343ae58-7bbf-47cc-b199-e4c0728b4787\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"
Jul 14 16:27:04.564305 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.564088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.564305 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.564104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-hub\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.564641 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.564612    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168e9a0a-5f42-4030-b573-7f653fb4c514-tmp\") pod \"klusterlet-addon-workmgr-5949bf46f-krrnj\" (UID: \"168e9a0a-5f42-4030-b573-7f653fb4c514\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.565419 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.565332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.576832 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.567958    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-hub\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.576832 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.567958    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/168e9a0a-5f42-4030-b573-7f653fb4c514-klusterlet-config\") pod \"klusterlet-addon-workmgr-5949bf46f-krrnj\" (UID: \"168e9a0a-5f42-4030-b573-7f653fb4c514\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.576832 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.568026    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.576832 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.568119    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e343ae58-7bbf-47cc-b199-e4c0728b4787-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bfcc494b8-xktgc\" (UID: \"e343ae58-7bbf-47cc-b199-e4c0728b4787\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"
Jul 14 16:27:04.576832 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.568516    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-ca\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.576832 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.568651    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.576832 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.570649    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-847bc8d77b-4vvlh"]
Jul 14 16:27:04.577689 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.577671    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgj2n\" (UniqueName: \"kubernetes.io/projected/3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd-kube-api-access-jgj2n\") pod \"cluster-proxy-proxy-agent-59c4466cd9-pk2gw\" (UID: \"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.578743 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.578693    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27ss6\" (UniqueName: \"kubernetes.io/projected/e343ae58-7bbf-47cc-b199-e4c0728b4787-kube-api-access-27ss6\") pod \"managed-serviceaccount-addon-agent-7bfcc494b8-xktgc\" (UID: \"e343ae58-7bbf-47cc-b199-e4c0728b4787\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"
Jul 14 16:27:04.578953 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.578904    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cm9m\" (UniqueName: \"kubernetes.io/projected/168e9a0a-5f42-4030-b573-7f653fb4c514-kube-api-access-7cm9m\") pod \"klusterlet-addon-workmgr-5949bf46f-krrnj\" (UID: \"168e9a0a-5f42-4030-b573-7f653fb4c514\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.664742 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.664702    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-installation-pull-secrets\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.664949 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.664758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-trusted-ca\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.664949 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.664887    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntpb4\" (UniqueName: \"kubernetes.io/projected/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-kube-api-access-ntpb4\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.665027 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.664955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-bound-sa-token\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.665027 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.664985    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-registry-tls\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.665027 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.665012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-ca-trust-extracted\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.665153 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.665043    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-registry-certificates\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.665153 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.665088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-image-registry-private-configuration\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.747625 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.747546    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:04.765560 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.765531    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"
Jul 14 16:27:04.765745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.765698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-ca-trust-extracted\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.765842 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.765749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-registry-certificates\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.765842 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.765813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-image-registry-private-configuration\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.765930 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.765877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-installation-pull-secrets\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.765930 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.765915    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-trusted-ca\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.766017 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.765973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntpb4\" (UniqueName: \"kubernetes.io/projected/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-kube-api-access-ntpb4\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.766066 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.766028    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-bound-sa-token\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.766120 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.766073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-registry-tls\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.766191 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.766170    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-ca-trust-extracted\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.766720 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.766697    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-registry-certificates\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.767603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.767573    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-trusted-ca\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.769113 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.769027    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-installation-pull-secrets\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.769418 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.769397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-registry-tls\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.769477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.769433    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-image-registry-private-configuration\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.776349 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.776320    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntpb4\" (UniqueName: \"kubernetes.io/projected/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-kube-api-access-ntpb4\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.776509 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.776490    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"
Jul 14 16:27:04.777735 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.777679    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ed2087b-3a48-43e7-acd3-7fe07d3ff751-bound-sa-token\") pod \"image-registry-847bc8d77b-4vvlh\" (UID: \"7ed2087b-3a48-43e7-acd3-7fe07d3ff751\") " pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:04.894501 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:04.894464    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:05.388837 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:05.388547    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw"]
Jul 14 16:27:05.390490 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:05.390453    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-847bc8d77b-4vvlh"]
Jul 14 16:27:05.391473 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:27:05.391444    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c1c39be_77d8_4e9e_9477_4c4ca19ae0dd.slice/crio-2dfe2215aab5f0789fe769ef253a8978bb0217212edc8f910c2c023f7efe9456 WatchSource:0}: Error finding container 2dfe2215aab5f0789fe769ef253a8978bb0217212edc8f910c2c023f7efe9456: Status 404 returned error can't find the container with id 2dfe2215aab5f0789fe769ef253a8978bb0217212edc8f910c2c023f7efe9456
Jul 14 16:27:05.393954 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:27:05.393929    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed2087b_3a48_43e7_acd3_7fe07d3ff751.slice/crio-a0b320344b1ea419066deb2a74fd8a36d4c7e44a4e15257e76b709f0a25e2f66 WatchSource:0}: Error finding container a0b320344b1ea419066deb2a74fd8a36d4c7e44a4e15257e76b709f0a25e2f66: Status 404 returned error can't find the container with id a0b320344b1ea419066deb2a74fd8a36d4c7e44a4e15257e76b709f0a25e2f66
Jul 14 16:27:05.409022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:05.408958    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc"]
Jul 14 16:27:05.411926 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:27:05.411899    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode343ae58_7bbf_47cc_b199_e4c0728b4787.slice/crio-a098dbaade1f56b04a0dffb5992aa23c0805fc5d6d12957822562765c4d78f73 WatchSource:0}: Error finding container a098dbaade1f56b04a0dffb5992aa23c0805fc5d6d12957822562765c4d78f73: Status 404 returned error can't find the container with id a098dbaade1f56b04a0dffb5992aa23c0805fc5d6d12957822562765c4d78f73
Jul 14 16:27:05.433341 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:05.433308    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"]
Jul 14 16:27:05.440125 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:27:05.440082    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168e9a0a_5f42_4030_b573_7f653fb4c514.slice/crio-4aa5ecc90300566326a2ede323f626bfe6d689a0910eb24d3354ac47b4cb89d3 WatchSource:0}: Error finding container 4aa5ecc90300566326a2ede323f626bfe6d689a0910eb24d3354ac47b4cb89d3: Status 404 returned error can't find the container with id 4aa5ecc90300566326a2ede323f626bfe6d689a0910eb24d3354ac47b4cb89d3
Jul 14 16:27:05.797416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:05.797382    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:05.883909 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:05.883872    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:06.010405 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:06.010364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj" event={"ID":"168e9a0a-5f42-4030-b573-7f653fb4c514","Type":"ContainerStarted","Data":"4aa5ecc90300566326a2ede323f626bfe6d689a0910eb24d3354ac47b4cb89d3"}
Jul 14 16:27:06.012932 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:06.012898    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q898l" event={"ID":"9bc128a5-b622-4c08-8f03-4996c20b2e7b","Type":"ContainerStarted","Data":"29719b345aa8a4ac1215bdb4129546139ea73ccc04426325611c2cc845d2ceec"}
Jul 14 16:27:06.014256 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:06.014224    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc" event={"ID":"e343ae58-7bbf-47cc-b199-e4c0728b4787","Type":"ContainerStarted","Data":"a098dbaade1f56b04a0dffb5992aa23c0805fc5d6d12957822562765c4d78f73"}
Jul 14 16:27:06.015495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:06.015466    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw" event={"ID":"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd","Type":"ContainerStarted","Data":"2dfe2215aab5f0789fe769ef253a8978bb0217212edc8f910c2c023f7efe9456"}
Jul 14 16:27:06.017495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:06.017471    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh" event={"ID":"7ed2087b-3a48-43e7-acd3-7fe07d3ff751","Type":"ContainerStarted","Data":"fe000a909c75fc33b86ceea308735c96363076224dffab32e46102c94b109373"}
Jul 14 16:27:06.017597 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:06.017515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh" event={"ID":"7ed2087b-3a48-43e7-acd3-7fe07d3ff751","Type":"ContainerStarted","Data":"a0b320344b1ea419066deb2a74fd8a36d4c7e44a4e15257e76b709f0a25e2f66"}
Jul 14 16:27:06.017731 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:06.017711    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:06.073304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:06.073185    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh" podStartSLOduration=2.073162228 podStartE2EDuration="2.073162228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:06.07281872 +0000 UTC m=+59.851982662" watchObservedRunningTime="2026-07-14 16:27:06.073162228 +0000 UTC m=+59.852326165"
Jul 14 16:27:06.074543 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:06.074492    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q898l" podStartSLOduration=17.711085463 podStartE2EDuration="25.074476913s" totalImagesPullingTime="7.36339145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:06.040878058 +0000 UTC m=+59.820041995" watchObservedRunningTime="2026-07-14 16:27:06.074476913 +0000 UTC m=+59.853640851"
Jul 14 16:27:07.420653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:07.420604    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:07.519364 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:07.519264    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:07.624572 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:07.624456    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:07.726476 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:07.726375    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:07.812046 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:07.811957    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:07.927126 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:07.925828    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjkcv"
Jul 14 16:27:08.105600 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:08.105561    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:08.170582 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:08.170422    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:09.009972 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:09.009937    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:09.035014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:09.034964    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc" event={"ID":"e343ae58-7bbf-47cc-b199-e4c0728b4787","Type":"ContainerStarted","Data":"1e863ee27d4bb6a4bc0c144061dd5374ce12f64061205a2ac9f286760bc48c8e"}
Jul 14 16:27:09.053498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:09.053440    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfcc494b8-xktgc" podStartSLOduration=2.243873684 podStartE2EDuration="5.053419607s" totalImagesPullingTime="2.809545923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:09.052379119 +0000 UTC m=+62.831543057" watchObservedRunningTime="2026-07-14 16:27:09.053419607 +0000 UTC m=+62.832583544"
Jul 14 16:27:09.109758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:09.109706    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:09.886255 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:09.886221    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:09.959109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:09.959014    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:10.040849 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:10.040812    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj" event={"ID":"168e9a0a-5f42-4030-b573-7f653fb4c514","Type":"ContainerStarted","Data":"2ca620ce70e13dfcce7b4ea8630e14ef8c56110e8f247074928458a46fcd684e"}
Jul 14 16:27:10.069701 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:10.069639    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj" podStartSLOduration=1.812442523 podStartE2EDuration="6.069618618s" totalImagesPullingTime="4.257176095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:10.069450983 +0000 UTC m=+63.848614921" watchObservedRunningTime="2026-07-14 16:27:10.069618618 +0000 UTC m=+63.848782571"
Jul 14 16:27:10.789404 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:10.789366    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:10.920998 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:10.920957    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:11.040335 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:11.040232    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:11.044402 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:11.044372    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:11.046489 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:11.046459    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5949bf46f-krrnj"
Jul 14 16:27:11.158017 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:11.157975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:12.547430 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.547389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:27:12.547870 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.547448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:27:12.547870 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.547485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:27:12.550256 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.550238    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 16:27:12.551197 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.551175    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 16:27:12.551259 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.551211    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 16:27:12.560624 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.560598    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22-original-pull-secret\") pod \"global-pull-secret-syncer-drncg\" (UID: \"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22\") " pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:27:12.560735 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.560598    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a561-eae4-4b49-a98b-a8b21f4ddfbc-metrics-certs\") pod \"network-metrics-daemon-rjqlc\" (UID: \"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc\") " pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:27:12.560735 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.560658    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 16:27:12.571194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.571137    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9lnx\" (UniqueName: \"kubernetes.io/projected/057b3092-bfd4-45a1-ae32-d0842c97e0e2-kube-api-access-h9lnx\") pod \"network-check-target-7tb9w\" (UID: \"057b3092-bfd4-45a1-ae32-d0842c97e0e2\") " pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:27:12.666178 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.666148    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dnkj4\""
Jul 14 16:27:12.670967 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.670943    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drncg"
Jul 14 16:27:12.673073 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.673053    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:27:12.684865 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.684843    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4qnb\""
Jul 14 16:27:12.688725 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.688706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjqlc"
Jul 14 16:27:12.848272 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.848095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drncg"]
Jul 14 16:27:12.851027 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:27:12.850986    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ff6a8a_d28d_48e9_b32c_4ff902e7bf22.slice/crio-5e42809a343c2d0eff09c9295bc29e430b0a306bdc70ffae81f6062a27a50b80 WatchSource:0}: Error finding container 5e42809a343c2d0eff09c9295bc29e430b0a306bdc70ffae81f6062a27a50b80: Status 404 returned error can't find the container with id 5e42809a343c2d0eff09c9295bc29e430b0a306bdc70ffae81f6062a27a50b80
Jul 14 16:27:12.873668 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.873636    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tb9w"]
Jul 14 16:27:12.876350 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:27:12.876318    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057b3092_bfd4_45a1_ae32_d0842c97e0e2.slice/crio-934668a56cc134481af744d20566ef20061605645b4de1c07c677dbc1eb5fcd0 WatchSource:0}: Error finding container 934668a56cc134481af744d20566ef20061605645b4de1c07c677dbc1eb5fcd0: Status 404 returned error can't find the container with id 934668a56cc134481af744d20566ef20061605645b4de1c07c677dbc1eb5fcd0
Jul 14 16:27:12.888934 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:12.888905    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rjqlc"]
Jul 14 16:27:12.891850 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:27:12.891823    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c0a561_eae4_4b49_a98b_a8b21f4ddfbc.slice/crio-c135971eb24ee943b76690ce66fb1e56de1b20648507605d369d8aab03fae01c WatchSource:0}: Error finding container c135971eb24ee943b76690ce66fb1e56de1b20648507605d369d8aab03fae01c: Status 404 returned error can't find the container with id c135971eb24ee943b76690ce66fb1e56de1b20648507605d369d8aab03fae01c
Jul 14 16:27:13.004174 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:13.004138    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4bbms"
Jul 14 16:27:13.051956 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:13.051923    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tb9w" event={"ID":"057b3092-bfd4-45a1-ae32-d0842c97e0e2","Type":"ContainerStarted","Data":"934668a56cc134481af744d20566ef20061605645b4de1c07c677dbc1eb5fcd0"}
Jul 14 16:27:13.054151 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:13.054121    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw" event={"ID":"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd","Type":"ContainerStarted","Data":"b61af17ff1a833def6758ac8760eb459ff96a822d7e89b54fff7c048ab711455"}
Jul 14 16:27:13.054297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:13.054165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw" event={"ID":"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd","Type":"ContainerStarted","Data":"8a0c7bb092cd5b03e348a9da712c14329183d1ca1d81480e1e76c920a674dcbb"}
Jul 14 16:27:13.054297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:13.054182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw" event={"ID":"3c1c39be-77d8-4e9e-9477-4c4ca19ae0dd","Type":"ContainerStarted","Data":"c606ae6725c5f4a3c1ee0069421009ec25b1999964fb52cbfae72e3f09b5b642"}
Jul 14 16:27:13.055622 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:13.055592    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rjqlc" event={"ID":"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc","Type":"ContainerStarted","Data":"c135971eb24ee943b76690ce66fb1e56de1b20648507605d369d8aab03fae01c"}
Jul 14 16:27:13.056726 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:13.056703    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drncg" event={"ID":"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22","Type":"ContainerStarted","Data":"5e42809a343c2d0eff09c9295bc29e430b0a306bdc70ffae81f6062a27a50b80"}
Jul 14 16:27:13.073745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:13.073561    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c4466cd9-pk2gw" podStartSLOduration=2.406883077 podStartE2EDuration="9.073540698s" totalImagesPullingTime="6.666657621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:13.073282927 +0000 UTC m=+66.852446874" watchObservedRunningTime="2026-07-14 16:27:13.073540698 +0000 UTC m=+66.852704634"
Jul 14 16:27:13.415517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:13.415476    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:14.469490 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:14.469445    2574 patch_prober.go:28] interesting pod/image-registry-5569bdfc46-flgsd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 16:27:14.469919 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:14.469509    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd" podUID="2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:27:14.843913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:14.843873    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:14.913295 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:14.913227    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:16.071347 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:16.071310    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rjqlc" event={"ID":"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc","Type":"ContainerStarted","Data":"1d4020000212e34602bb541c28a601e6702bebdfe6b931fa8509875acb34ce38"}
Jul 14 16:27:16.071851 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:16.071379    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rjqlc" event={"ID":"75c0a561-eae4-4b49-a98b-a8b21f4ddfbc","Type":"ContainerStarted","Data":"9d64f33e0b5b1f3a5f9889ee876c4299dcf888dbbf0b996df0ec4e77bc3024a8"}
Jul 14 16:27:16.090992 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:16.089599    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rjqlc" podStartSLOduration=67.73061173400001 podStartE2EDuration="1m10.089582764s" totalImagesPullingTime="2.35897103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:16.088675914 +0000 UTC m=+69.867839851" watchObservedRunningTime="2026-07-14 16:27:16.089582764 +0000 UTC m=+69.868746707"
Jul 14 16:27:16.592737 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:16.592693    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:16.655685 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:16.655641    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:16.808324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:16.808217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:16.877752 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:16.877667    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:17.554606 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:17.554508    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:19.085323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:19.085280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drncg" event={"ID":"c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22","Type":"ContainerStarted","Data":"070081440d8323f87eac41d71de2574960dd04a94e6dfdc55545ff57ab7b4289"}
Jul 14 16:27:19.086707 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:19.086682    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tb9w" event={"ID":"057b3092-bfd4-45a1-ae32-d0842c97e0e2","Type":"ContainerStarted","Data":"4caf4c3c32d47f34aa24a3fc7fe894d2ea0ad501b6411865df91963adc7aa5bc"}
Jul 14 16:27:19.086870 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:19.086854    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:27:19.145885 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:19.145832    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-drncg" podStartSLOduration=67.845398556 podStartE2EDuration="1m13.145818146s" totalImagesPullingTime="5.30041959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:19.144387132 +0000 UTC m=+72.923551069" watchObservedRunningTime="2026-07-14 16:27:19.145818146 +0000 UTC m=+72.924982081"
Jul 14 16:27:19.189957 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:19.189893    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7tb9w" podStartSLOduration=67.913674235 podStartE2EDuration="1m13.189873804s" totalImagesPullingTime="5.276199569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:19.187373309 +0000 UTC m=+72.966537245" watchObservedRunningTime="2026-07-14 16:27:19.189873804 +0000 UTC m=+72.969037743"
Jul 14 16:27:20.036024 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.035956    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:20.131890 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.131849    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:20.246442 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.246405    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:20.348635 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.348541    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:20.384148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.384102    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6bv8h"]
Jul 14 16:27:20.386926 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.386901    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.392455 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.392426    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 16:27:20.392706 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.392687    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 16:27:20.392915 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.392897    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 16:27:20.393499 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.393475    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhpw6\""
Jul 14 16:27:20.393690 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.393674    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 16:27:20.393937 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.393920    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 16:27:20.394964 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.394942    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 16:27:20.472810 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.472754    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:20.515826 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.515764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-textfile\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.516000 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.515832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjk52\" (UniqueName: \"kubernetes.io/projected/8eda014f-d28a-4baf-be04-796fa27f0426-kube-api-access-bjk52\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.516000 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.515869    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8eda014f-d28a-4baf-be04-796fa27f0426-root\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.516000 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.515889    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8eda014f-d28a-4baf-be04-796fa27f0426-sys\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.516000 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.515927    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-tls\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.516289 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.516002    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eda014f-d28a-4baf-be04-796fa27f0426-metrics-client-ca\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.516289 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.516065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-wtmp\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.516289 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.516096    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.516289 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.516140    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.582496 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.582461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:20.616810 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.616694    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-wtmp\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.616810 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.616738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.616865    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.616913    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-textfile\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.616938    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjk52\" (UniqueName: \"kubernetes.io/projected/8eda014f-d28a-4baf-be04-796fa27f0426-kube-api-access-bjk52\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.616938    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-wtmp\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.616976    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8eda014f-d28a-4baf-be04-796fa27f0426-root\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.617003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8eda014f-d28a-4baf-be04-796fa27f0426-sys\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.617067    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-tls\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.617098    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8eda014f-d28a-4baf-be04-796fa27f0426-root\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.617104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eda014f-d28a-4baf-be04-796fa27f0426-metrics-client-ca\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.617072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8eda014f-d28a-4baf-be04-796fa27f0426-sys\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.617318    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-textfile\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617926 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.617516    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.617926 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.617724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eda014f-d28a-4baf-be04-796fa27f0426-metrics-client-ca\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.619274 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.619254    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.620022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.620000    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8eda014f-d28a-4baf-be04-796fa27f0426-node-exporter-tls\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.632336 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.632297    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjk52\" (UniqueName: \"kubernetes.io/projected/8eda014f-d28a-4baf-be04-796fa27f0426-kube-api-access-bjk52\") pod \"node-exporter-6bv8h\" (UID: \"8eda014f-d28a-4baf-be04-796fa27f0426\") " pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.687183 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.687142    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:20.703040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.703007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6bv8h"
Jul 14 16:27:20.716088 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:27:20.716053    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eda014f_d28a_4baf_be04_796fa27f0426.slice/crio-8b290fc4fea05ae20a0d9cdc57a695636420c1b4f869580b01a5c65074f9a44d WatchSource:0}: Error finding container 8b290fc4fea05ae20a0d9cdc57a695636420c1b4f869580b01a5c65074f9a44d: Status 404 returned error can't find the container with id 8b290fc4fea05ae20a0d9cdc57a695636420c1b4f869580b01a5c65074f9a44d
Jul 14 16:27:20.791505 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:20.791461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:21.003598 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:21.003553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:21.094697 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:21.094658    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bv8h" event={"ID":"8eda014f-d28a-4baf-be04-796fa27f0426","Type":"ContainerStarted","Data":"8b290fc4fea05ae20a0d9cdc57a695636420c1b4f869580b01a5c65074f9a44d"}
Jul 14 16:27:21.338477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:21.338381    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:21.444689 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:21.444657    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:21.541049 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:21.541015    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:21.644638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:21.644547    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:22.100317 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:22.100276    2574 generic.go:356] "Generic (PLEG): container finished" podID="8eda014f-d28a-4baf-be04-796fa27f0426" containerID="1c40deeb42c2ca20b6c2ea1434835ce9264df49d0dd2693d0552699733196775" exitCode=0
Jul 14 16:27:22.100523 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:22.100344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bv8h" event={"ID":"8eda014f-d28a-4baf-be04-796fa27f0426","Type":"ContainerDied","Data":"1c40deeb42c2ca20b6c2ea1434835ce9264df49d0dd2693d0552699733196775"}
Jul 14 16:27:22.174232 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:22.174201    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:22.380752 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:22.380712    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:23.105903 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:23.105866    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bv8h" event={"ID":"8eda014f-d28a-4baf-be04-796fa27f0426","Type":"ContainerStarted","Data":"2ac6643d582774c374da8e1b1261cab849bbe7da734bf16711831443331ba168"}
Jul 14 16:27:23.106084 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:23.105921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bv8h" event={"ID":"8eda014f-d28a-4baf-be04-796fa27f0426","Type":"ContainerStarted","Data":"7c4dd44d8f2f9a2888e76ac5b3babe0cf4d50198cff72146ec75a57caff33481"}
Jul 14 16:27:23.135741 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:23.135687    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6bv8h" podStartSLOduration=1.9266373959999998 podStartE2EDuration="3.135668442s" totalImagesPullingTime="1.135595012s" totalInitContainerRuntime="73.436034ms" isStatefulPod=true podCreationTimestamp="2026-07-14 16:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:23.134855671 +0000 UTC m=+76.914019606" watchObservedRunningTime="2026-07-14 16:27:23.135668442 +0000 UTC m=+76.914832377"
Jul 14 16:27:23.418141 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:23.418046    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:23.485947 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:23.485903    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:24.467589 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:24.467558    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:27:24.745322 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:24.745223    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:24.844493 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:24.844456    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:24.943539 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:24.943497    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:25.094612 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:25.094579    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:25.196235 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:25.196193    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:25.282495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:25.282436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:25.755908 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:25.755878    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:25.856612 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:25.856575    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:25.956292 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:25.956256    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:26.350008 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:26.349969    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:26.450686 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:26.450544    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:26.741407 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:26.741309    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:27.029353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:27.029324    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-847bc8d77b-4vvlh"
Jul 14 16:27:27.168545 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:27.168509    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:27.368357 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:27.368252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:27.438111 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:27.438072    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:28.256627 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:28.256590    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:28.330012 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:28.329973    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:29.494511 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.494462    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd" podUID="2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" containerName="registry" containerID="cri-o://8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112" gracePeriod=30
Jul 14 16:27:29.742025 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.741998    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:27:29.892945 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.892915    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-ca-trust-extracted\") pod \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") "
Jul 14 16:27:29.892945 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.892952    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-installation-pull-secrets\") pod \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") "
Jul 14 16:27:29.893211 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.892973    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvb4p\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-kube-api-access-tvb4p\") pod \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") "
Jul 14 16:27:29.893211 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.892992    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") pod \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") "
Jul 14 16:27:29.893211 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.893066    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-image-registry-private-configuration\") pod \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") "
Jul 14 16:27:29.893211 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.893090    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-bound-sa-token\") pod \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") "
Jul 14 16:27:29.893211 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.893124    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-trusted-ca\") pod \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") "
Jul 14 16:27:29.893211 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.893148    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-certificates\") pod \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\" (UID: \"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf\") "
Jul 14 16:27:29.893720 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.893645    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:27:29.893720 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.893668    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:27:29.895840 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.895805    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:27:29.895963 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.895883    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-kube-api-access-tvb4p" (OuterVolumeSpecName: "kube-api-access-tvb4p") pod "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf"). InnerVolumeSpecName "kube-api-access-tvb4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:27:29.896042 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.895978    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:27:29.896042 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.896011    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:27:29.896114 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.896040    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:27:29.902005 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.901977    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" (UID: "2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:27:29.994525 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.994485    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-image-registry-private-configuration\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:27:29.994525 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.994518    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-bound-sa-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:27:29.994525 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.994527    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-trusted-ca\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:27:29.994525 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.994534    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-certificates\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:27:29.994816 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.994543    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-ca-trust-extracted\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:27:29.994816 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.994552    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-installation-pull-secrets\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:27:29.994816 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.994560    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvb4p\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-kube-api-access-tvb4p\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:27:29.994816 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:29.994568    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf-registry-tls\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:27:30.133140 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.133108    2574 generic.go:356] "Generic (PLEG): container finished" podID="2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" containerID="8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112" exitCode=0
Jul 14 16:27:30.133323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.133153    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd"
Jul 14 16:27:30.133323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.133166    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd" event={"ID":"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf","Type":"ContainerDied","Data":"8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112"}
Jul 14 16:27:30.133323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.133217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5569bdfc46-flgsd" event={"ID":"2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf","Type":"ContainerDied","Data":"d6996c3ce9fc9adeff7ce8d71a5ec984c8ef5f9003c790691d7d73b91c0592e6"}
Jul 14 16:27:30.133323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.133244    2574 scope.go:117] "RemoveContainer" containerID="8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112"
Jul 14 16:27:30.142324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.142302    2574 scope.go:117] "RemoveContainer" containerID="8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112"
Jul 14 16:27:30.142670 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:27:30.142637    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112\": container with ID starting with 8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112 not found: ID does not exist" containerID="8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112"
Jul 14 16:27:30.142726 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.142682    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112"} err="failed to get container status \"8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112\": rpc error: code = NotFound desc = could not find container \"8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112\": container with ID starting with 8c5a3697a28b95f1168eea22ea2b549c6bdc6829a17a9c6de79a75b425625112 not found: ID does not exist"
Jul 14 16:27:30.157675 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.157578    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5569bdfc46-flgsd"]
Jul 14 16:27:30.162262 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.162226    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5569bdfc46-flgsd"]
Jul 14 16:27:30.408127 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.408032    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:30.509740 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.509709    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:30.688705 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.688618    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:30.755328 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.755294    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" path="/var/lib/kubelet/pods/2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf/volumes"
Jul 14 16:27:30.789131 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:30.789097    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:38.149641 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:38.149598    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:38.220411 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:38.220362    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:39.769993 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:39.769952    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:39.832532 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:39.832490    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:40.178626 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:40.178543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:40.242295 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:40.242262    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:43.934001 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:43.933956    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:44.036430 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:44.036386    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:44.120093 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:44.120056    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:47.196014 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:47.195981    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:47.377140 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:47.377111    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:50.093049 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:50.093017    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7tb9w"
Jul 14 16:27:57.687429 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:57.687382    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:57.750121 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:27:57.750082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:02.575225 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:02.575185    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:02.659804 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:02.659741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:36.549856 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:36.549813    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:36.651121 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:36.651086    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:37.675527 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:37.675485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:37.776245 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:37.776208    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:37.877322 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:37.877289    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:38.419638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:38.419600    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:48.124984 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:48.124948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:48.225894 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:48.225862    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:48.279975 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:48.279937    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:48.504705 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:48.504671    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:48.562343 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:28:48.562311    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:02.103769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:29:02.103684    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:02.203766 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:29:02.203733    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:18.659621 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:29:18.659566    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:18.723875 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:29:18.723835    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:34.088282 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:29:34.088234    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:40.462352 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:29:40.462311    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:40.560262 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:29:40.560213    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:01.792944 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:01.792906    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:03.152354 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:03.152317    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:05.655861 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:05.655817    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:05.752305 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:05.752264    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:08.281861 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:08.281821    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:08.379269 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:08.379226    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:08.729847 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:08.729746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:08.881022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:08.880981    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:10.485374 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:10.485343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:10.689674 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:10.689634    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:12.494490 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:12.494459    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:12.553065 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:12.553026    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:13.243876 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:13.243842    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:13.338271 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:13.338233    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:18.534657 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:18.534614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:19.081312 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:19.081270    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:19.800705 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:19.800665    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:20.089754 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:20.089661    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:20.188023 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:20.187988    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:25.794366 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:25.794332    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:25.893900 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:25.893861    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:27.661210 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:27.661137    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:28.065485 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:28.065452    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:28.139755 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:28.139716    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:34.988594 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:34.988557    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:35.046716 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:35.046677    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:40.837811 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:40.837752    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:40.928676 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:40.928638    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:41.446854 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.446810    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:41.600943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.600903    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:41.738846 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.738747    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"]
Jul 14 16:30:41.739015 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.739002    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" containerName="registry"
Jul 14 16:30:41.739068 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.739017    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" containerName="registry"
Jul 14 16:30:41.739105 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.739080    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e5a79b7-74ab-49a2-bac1-1b4f4cf54ccf" containerName="registry"
Jul 14 16:30:41.741115 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.741099    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:41.743742 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.743718    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 16:30:41.743893 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.743801    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 16:30:41.744849 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.744832    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 16:30:41.744968 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.744945    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qzpl7\""
Jul 14 16:30:41.745170 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.744955    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 16:30:41.755693 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.755666    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"]
Jul 14 16:30:41.772099 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.772066    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:41.867579 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.867539    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:41.905382 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.905349    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c6b761f-b2d3-40b1-bc31-fd1719822717-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:41.905527 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.905396    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c6b761f-b2d3-40b1-bc31-fd1719822717-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:41.905527 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.905417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c6b761f-b2d3-40b1-bc31-fd1719822717-manifests\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:41.905527 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.905437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c6b761f-b2d3-40b1-bc31-fd1719822717-tmp\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:41.905527 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.905493    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngvlc\" (UniqueName: \"kubernetes.io/projected/8c6b761f-b2d3-40b1-bc31-fd1719822717-kube-api-access-ngvlc\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:41.995546 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:41.995458    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:42.006538 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.006506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c6b761f-b2d3-40b1-bc31-fd1719822717-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.006691 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.006547    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c6b761f-b2d3-40b1-bc31-fd1719822717-manifests\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.006691 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.006564    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c6b761f-b2d3-40b1-bc31-fd1719822717-tmp\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.006691 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.006612    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvlc\" (UniqueName: \"kubernetes.io/projected/8c6b761f-b2d3-40b1-bc31-fd1719822717-kube-api-access-ngvlc\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.006691 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.006642    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c6b761f-b2d3-40b1-bc31-fd1719822717-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.007028 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.007003    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c6b761f-b2d3-40b1-bc31-fd1719822717-manifests\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.009123 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.009093    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c6b761f-b2d3-40b1-bc31-fd1719822717-tmp\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.009346 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.009330    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c6b761f-b2d3-40b1-bc31-fd1719822717-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.009451 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.009432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c6b761f-b2d3-40b1-bc31-fd1719822717-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.026629 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.026592    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvlc\" (UniqueName: \"kubernetes.io/projected/8c6b761f-b2d3-40b1-bc31-fd1719822717-kube-api-access-ngvlc\") pod \"opendatahub-operator-controller-manager-b6f9446cf-v8jrr\" (UID: \"8c6b761f-b2d3-40b1-bc31-fd1719822717\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.051261 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.051221    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:42.071659 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.071626    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:42.174993 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.174956    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:42.192620 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.192597    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"]
Jul 14 16:30:42.195420 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:30:42.195385    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6b761f_b2d3_40b1_bc31_fd1719822717.slice/crio-0034d125a61362e3bfa6291c0d2bf2c7367b3867df4ca339b0d732b5fc9e4bab WatchSource:0}: Error finding container 0034d125a61362e3bfa6291c0d2bf2c7367b3867df4ca339b0d732b5fc9e4bab: Status 404 returned error can't find the container with id 0034d125a61362e3bfa6291c0d2bf2c7367b3867df4ca339b0d732b5fc9e4bab
Jul 14 16:30:42.349856 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.349818    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:42.783275 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:42.783242    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr" event={"ID":"8c6b761f-b2d3-40b1-bc31-fd1719822717","Type":"ContainerStarted","Data":"0034d125a61362e3bfa6291c0d2bf2c7367b3867df4ca339b0d732b5fc9e4bab"}
Jul 14 16:30:46.801826 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:46.801767    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr" event={"ID":"8c6b761f-b2d3-40b1-bc31-fd1719822717","Type":"ContainerStarted","Data":"ee8798a1be26a0a1473120da1622176a660f1f01868709b9ac3bf3c18d94eea2"}
Jul 14 16:30:47.807013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:47.806976    2574 generic.go:356] "Generic (PLEG): container finished" podID="8c6b761f-b2d3-40b1-bc31-fd1719822717" containerID="ee8798a1be26a0a1473120da1622176a660f1f01868709b9ac3bf3c18d94eea2" exitCode=0
Jul 14 16:30:47.807440 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:47.807065    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr" event={"ID":"8c6b761f-b2d3-40b1-bc31-fd1719822717","Type":"ContainerDied","Data":"ee8798a1be26a0a1473120da1622176a660f1f01868709b9ac3bf3c18d94eea2"}
Jul 14 16:30:48.812802 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:48.812751    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr" event={"ID":"8c6b761f-b2d3-40b1-bc31-fd1719822717","Type":"ContainerStarted","Data":"31852d8737b52a9e85e29f66a18b8617d60c3f7429719f6e86c5d3712468a572"}
Jul 14 16:30:48.813297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:48.812881    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:30:48.835013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:48.834961    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr" podStartSLOduration=2.6904179729999997 podStartE2EDuration="7.834944476s" totalImagesPullingTime="4.082296477s" totalInitContainerRuntime="1.062230026s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:48.833764463 +0000 UTC m=+282.612928409" watchObservedRunningTime="2026-07-14 16:30:48.834944476 +0000 UTC m=+282.614108411"
Jul 14 16:30:52.619631 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:52.619590    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:52.710259 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:52.710220    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:53.351433 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:53.351393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:53.452242 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:53.452192    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:56.313991 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:56.313954    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:59.818541 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:30:59.818506    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-v8jrr"
Jul 14 16:31:02.508646 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:02.508608    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:03.747109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:03.747066    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:03.853391 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:03.853358    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:04.311308 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.311272    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:04.343997 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.343962    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"]
Jul 14 16:31:04.350260 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.350236    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.353157 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.353136    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 16:31:04.353406 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.353387    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 16:31:04.353860 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.353844    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 16:31:04.354295 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.354280    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 16:31:04.373068 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.373030    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"]
Jul 14 16:31:04.387297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.387251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8kqb\" (UniqueName: \"kubernetes.io/projected/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-kube-api-access-q8kqb\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.387471 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.387308    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-tmp\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.387471 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.387342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-tls-certs\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.488056 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.487990    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-tmp\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.488056 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.488066    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-tls-certs\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.488317 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.488100    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8kqb\" (UniqueName: \"kubernetes.io/projected/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-kube-api-access-q8kqb\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.488317 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:31:04.488230    2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 14 16:31:04.488317 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:31:04.488306    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-tls-certs podName:adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:04.988288733 +0000 UTC m=+298.767452650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-tls-certs") pod "kube-auth-proxy-75f7bf6bc6-qd8tz" (UID: "adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8") : secret "kube-auth-proxy-tls" not found
Jul 14 16:31:04.490590 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.490555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-tmp\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.503626 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.503587    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8kqb\" (UniqueName: \"kubernetes.io/projected/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-kube-api-access-q8kqb\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.571354 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.571267    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lbzw2"]
Jul 14 16:31:04.573826 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.573806    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:04.577071 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.577045    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-swvsl\""
Jul 14 16:31:04.577196 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.577053    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 14 16:31:04.586687 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.586656    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lbzw2"]
Jul 14 16:31:04.589072 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.588867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e-cert\") pod \"odh-model-controller-7998c67dc4-lbzw2\" (UID: \"9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e\") " pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:04.589072 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.588975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zg2b\" (UniqueName: \"kubernetes.io/projected/9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e-kube-api-access-7zg2b\") pod \"odh-model-controller-7998c67dc4-lbzw2\" (UID: \"9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e\") " pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:04.617924 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.617886    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:04.690084 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.690054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e-cert\") pod \"odh-model-controller-7998c67dc4-lbzw2\" (UID: \"9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e\") " pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:04.690271 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.690148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zg2b\" (UniqueName: \"kubernetes.io/projected/9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e-kube-api-access-7zg2b\") pod \"odh-model-controller-7998c67dc4-lbzw2\" (UID: \"9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e\") " pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:04.692623 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.692604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e-cert\") pod \"odh-model-controller-7998c67dc4-lbzw2\" (UID: \"9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e\") " pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:04.701894 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.701865    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zg2b\" (UniqueName: \"kubernetes.io/projected/9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e-kube-api-access-7zg2b\") pod \"odh-model-controller-7998c67dc4-lbzw2\" (UID: \"9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e\") " pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:04.719046 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.719006    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:04.815588 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.815547    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:04.884991 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.884898    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:04.915595 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.915555    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:04.992495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.992454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-tls-certs\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:04.995350 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:04.995320    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8-tls-certs\") pod \"kube-auth-proxy-75f7bf6bc6-qd8tz\" (UID: \"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:05.033561 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:31:05.033527    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d87a3ef_7f8b_4b46_8bcc_78a9ecde295e.slice/crio-7b4e69a2ce109cb4b2a6ce0920343c8ebfe9a2a563dcb0ea0c7a1dbd823896e5 WatchSource:0}: Error finding container 7b4e69a2ce109cb4b2a6ce0920343c8ebfe9a2a563dcb0ea0c7a1dbd823896e5: Status 404 returned error can't find the container with id 7b4e69a2ce109cb4b2a6ce0920343c8ebfe9a2a563dcb0ea0c7a1dbd823896e5
Jul 14 16:31:05.040120 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.040080    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lbzw2"]
Jul 14 16:31:05.260388 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.260346    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"
Jul 14 16:31:05.432665 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.432634    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz"]
Jul 14 16:31:05.435232 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:31:05.435205    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf4f1ca_b6cb_4c17_8f53_f1b4a9609db8.slice/crio-d479e417d838fa34855842f3508a83463298ab950510ecec8f2cac23877f5685 WatchSource:0}: Error finding container d479e417d838fa34855842f3508a83463298ab950510ecec8f2cac23877f5685: Status 404 returned error can't find the container with id d479e417d838fa34855842f3508a83463298ab950510ecec8f2cac23877f5685
Jul 14 16:31:05.526937 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.526836    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zcb4j"]
Jul 14 16:31:05.529922 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.529895    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:05.532440 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.532412    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 14 16:31:05.543750 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.543721    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zcb4j"]
Jul 14 16:31:05.598933 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.598899    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47tdc\" (UniqueName: \"kubernetes.io/projected/489aacb6-fad5-41d1-a9f0-d708d6084d24-kube-api-access-47tdc\") pod \"model-serving-api-54d89bd5fc-zcb4j\" (UID: \"489aacb6-fad5-41d1-a9f0-d708d6084d24\") " pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:05.599109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.598959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489aacb6-fad5-41d1-a9f0-d708d6084d24-tls-certs\") pod \"model-serving-api-54d89bd5fc-zcb4j\" (UID: \"489aacb6-fad5-41d1-a9f0-d708d6084d24\") " pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:05.700089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.700053    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47tdc\" (UniqueName: \"kubernetes.io/projected/489aacb6-fad5-41d1-a9f0-d708d6084d24-kube-api-access-47tdc\") pod \"model-serving-api-54d89bd5fc-zcb4j\" (UID: \"489aacb6-fad5-41d1-a9f0-d708d6084d24\") " pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:05.700263 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.700125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489aacb6-fad5-41d1-a9f0-d708d6084d24-tls-certs\") pod \"model-serving-api-54d89bd5fc-zcb4j\" (UID: \"489aacb6-fad5-41d1-a9f0-d708d6084d24\") " pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:05.700263 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:31:05.700237    2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 14 16:31:05.700338 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:31:05.700297    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/489aacb6-fad5-41d1-a9f0-d708d6084d24-tls-certs podName:489aacb6-fad5-41d1-a9f0-d708d6084d24 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:06.200279237 +0000 UTC m=+299.979443152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/489aacb6-fad5-41d1-a9f0-d708d6084d24-tls-certs") pod "model-serving-api-54d89bd5fc-zcb4j" (UID: "489aacb6-fad5-41d1-a9f0-d708d6084d24") : secret "model-serving-api-tls" not found
Jul 14 16:31:05.725441 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.725405    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47tdc\" (UniqueName: \"kubernetes.io/projected/489aacb6-fad5-41d1-a9f0-d708d6084d24-kube-api-access-47tdc\") pod \"model-serving-api-54d89bd5fc-zcb4j\" (UID: \"489aacb6-fad5-41d1-a9f0-d708d6084d24\") " pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:05.810937 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.810848    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"]
Jul 14 16:31:05.812998 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.812981    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:05.816147 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.816120    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 16:31:05.816147 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.816143    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 16:31:05.816622 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.816607    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kgmkt\""
Jul 14 16:31:05.816829 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.816816    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 16:31:05.818095 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.818077    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 16:31:05.871581 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.871539    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz" event={"ID":"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8","Type":"ContainerStarted","Data":"d479e417d838fa34855842f3508a83463298ab950510ecec8f2cac23877f5685"}
Jul 14 16:31:05.872599 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.872561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2" event={"ID":"9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e","Type":"ContainerStarted","Data":"7b4e69a2ce109cb4b2a6ce0920343c8ebfe9a2a563dcb0ea0c7a1dbd823896e5"}
Jul 14 16:31:05.897323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.897286    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"]
Jul 14 16:31:05.901434 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.901405    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:05.901603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.901461    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:05.901603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.901489    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-cacerts\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:05.901603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.901514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-token\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:05.901603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.901552    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/336442e4-26fe-4e66-98e2-7f9e8fa629d8-local-certs\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:05.901603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.901577    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:05.901809 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:05.901610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsxvr\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-kube-api-access-dsxvr\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.002250 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.002202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.002250 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.002256    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-cacerts\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.002511 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.002285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-token\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.002511 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.002330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/336442e4-26fe-4e66-98e2-7f9e8fa629d8-local-certs\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.002511 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.002355    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.002511 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.002386    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsxvr\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-kube-api-access-dsxvr\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.002511 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.002459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.003298 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.003264    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.004890 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.004866    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/336442e4-26fe-4e66-98e2-7f9e8fa629d8-local-certs\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.005026 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.004992    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-cacerts\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.005100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.005050    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.005189 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.005170    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.015871 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.015837    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-token\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.016194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.016173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsxvr\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-kube-api-access-dsxvr\") pod \"istiod-openshift-gateway-7574459656-4kzx9\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.122945 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.122852    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:06.203632 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.203602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489aacb6-fad5-41d1-a9f0-d708d6084d24-tls-certs\") pod \"model-serving-api-54d89bd5fc-zcb4j\" (UID: \"489aacb6-fad5-41d1-a9f0-d708d6084d24\") " pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:06.206446 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.206418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489aacb6-fad5-41d1-a9f0-d708d6084d24-tls-certs\") pod \"model-serving-api-54d89bd5fc-zcb4j\" (UID: \"489aacb6-fad5-41d1-a9f0-d708d6084d24\") " pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:06.283480 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.283452    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"]
Jul 14 16:31:06.284947 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:31:06.284917    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336442e4_26fe_4e66_98e2_7f9e8fa629d8.slice/crio-857478373ffa79234554ffb457c966f48d71a55706f4b066632d23dcce752aba WatchSource:0}: Error finding container 857478373ffa79234554ffb457c966f48d71a55706f4b066632d23dcce752aba: Status 404 returned error can't find the container with id 857478373ffa79234554ffb457c966f48d71a55706f4b066632d23dcce752aba
Jul 14 16:31:06.440171 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.440075    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:06.607448 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.607413    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zcb4j"]
Jul 14 16:31:06.609354 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.609311    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:31:06.609910 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.609894    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:31:06.610900 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:31:06.610878    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489aacb6_fad5_41d1_a9f0_d708d6084d24.slice/crio-b96ac474359127774569866df10de7c69a75d71ab1dc89ebf5cfce81293d95ef WatchSource:0}: Error finding container b96ac474359127774569866df10de7c69a75d71ab1dc89ebf5cfce81293d95ef: Status 404 returned error can't find the container with id b96ac474359127774569866df10de7c69a75d71ab1dc89ebf5cfce81293d95ef
Jul 14 16:31:06.613488 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.613469    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 16:31:06.878596 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.878410    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9" event={"ID":"336442e4-26fe-4e66-98e2-7f9e8fa629d8","Type":"ContainerStarted","Data":"857478373ffa79234554ffb457c966f48d71a55706f4b066632d23dcce752aba"}
Jul 14 16:31:06.894198 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:06.879809    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j" event={"ID":"489aacb6-fad5-41d1-a9f0-d708d6084d24","Type":"ContainerStarted","Data":"b96ac474359127774569866df10de7c69a75d71ab1dc89ebf5cfce81293d95ef"}
Jul 14 16:31:07.613016 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:07.612973    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:07.694615 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:07.694570    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:11.952254 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:11.952235    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 16:31:12.013035 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.012994    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:31:12.013188 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.013080    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:31:12.913159 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.913117    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2" event={"ID":"9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e","Type":"ContainerStarted","Data":"6596259b8f4aac75a303f084097a5be9dc19c93aac25a4cd6175ac6ca08787af"}
Jul 14 16:31:12.913381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.913209    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:12.914735 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.914703    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j" event={"ID":"489aacb6-fad5-41d1-a9f0-d708d6084d24","Type":"ContainerStarted","Data":"7ef22153ed080b73c5a4cfa366e9d0fd2e41ff3b567adbbb0e059bda010932b4"}
Jul 14 16:31:12.914907 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.914756    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:12.916305 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.916281    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9" event={"ID":"336442e4-26fe-4e66-98e2-7f9e8fa629d8","Type":"ContainerStarted","Data":"c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06"}
Jul 14 16:31:12.916418 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.916328    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:12.917808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.917771    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz" event={"ID":"adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8","Type":"ContainerStarted","Data":"9d88998aab7117a95a5bb446d6250c7bffaf3f59b2c77db1ac0b851832c16131"}
Jul 14 16:31:12.945857 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.945743    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2" podStartSLOduration=2.023807547 podStartE2EDuration="8.945723958s" totalImagesPullingTime="6.921916411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:12.944513561 +0000 UTC m=+306.723677496" watchObservedRunningTime="2026-07-14 16:31:12.945723958 +0000 UTC m=+306.724887891"
Jul 14 16:31:12.983348 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:12.983291    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-qd8tz" podStartSLOduration=2.472677081 podStartE2EDuration="8.983274041s" totalImagesPullingTime="6.51059696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:12.981134098 +0000 UTC m=+306.760298033" watchObservedRunningTime="2026-07-14 16:31:12.983274041 +0000 UTC m=+306.762437976"
Jul 14 16:31:13.015933 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.015864    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j" podStartSLOduration=2.685181551 podStartE2EDuration="8.015839204s" totalImagesPullingTime="5.330657653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:13.014352551 +0000 UTC m=+306.793516488" watchObservedRunningTime="2026-07-14 16:31:13.015839204 +0000 UTC m=+306.795003141"
Jul 14 16:31:13.039092 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.039020    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9" podStartSLOduration=2.3133192 podStartE2EDuration="8.038997425s" totalImagesPullingTime="5.725678225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:13.037707411 +0000 UTC m=+306.816871348" watchObservedRunningTime="2026-07-14 16:31:13.038997425 +0000 UTC m=+306.818161361"
Jul 14 16:31:13.173774 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.173678    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:13.278697 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.278622    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:13.504929 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.504893    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"]
Jul 14 16:31:13.508343 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.508313    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.512695 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.512668    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mr82q\""
Jul 14 16:31:13.540719 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.540679    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"]
Jul 14 16:31:13.570017 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.569982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.570212 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.570033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.570212 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.570071    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.570212 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.570091    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.570212 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.570106    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.570212 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.570162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89gwt\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-kube-api-access-89gwt\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.570452 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.570235    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.570452 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.570273    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.570452 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.570302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.571066 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.571041    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:13.641941 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.641904    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"]
Jul 14 16:31:13.645114 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.645092    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.671359 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671329    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.671563 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671369    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.671563 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.671563 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671432    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.671563 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671538    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.671758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.671758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671614    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sd4f\" (UniqueName: \"kubernetes.io/projected/c2792f6c-264d-449d-80a6-2600a087def3-kube-api-access-5sd4f\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.671758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671654    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.671758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89gwt\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-kube-api-access-89gwt\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.671758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671711    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.672022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2792f6c-264d-449d-80a6-2600a087def3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.672022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671767    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.672022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671829    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.672022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671862    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.672022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671900    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.672022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.671962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.672022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.672003    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2792f6c-264d-449d-80a6-2600a087def3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.672353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.672039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.672353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.672074    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.672353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.672102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2792f6c-264d-449d-80a6-2600a087def3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.672353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.672251    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.672353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.672283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.672353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.672346    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.673888 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.673867    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.674613 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.674589    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.684648 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.684610    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"]
Jul 14 16:31:13.690897 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.690855    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89gwt\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-kube-api-access-89gwt\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.691610 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.691592    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.773553 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.773553 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2792f6c-264d-449d-80a6-2600a087def3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.773753 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.773753 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sd4f\" (UniqueName: \"kubernetes.io/projected/c2792f6c-264d-449d-80a6-2600a087def3-kube-api-access-5sd4f\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.773753 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.773951 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773768    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.773951 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773850    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2792f6c-264d-449d-80a6-2600a087def3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.773951 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773890    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.773951 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2792f6c-264d-449d-80a6-2600a087def3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.774135 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.773994    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.774135 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.774054    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.774248 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.774231    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.774289 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.774232    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2792f6c-264d-449d-80a6-2600a087def3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.774423 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.774407    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.776086 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.776063    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2792f6c-264d-449d-80a6-2600a087def3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.776602 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.776580    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2792f6c-264d-449d-80a6-2600a087def3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.796231 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.796198    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2792f6c-264d-449d-80a6-2600a087def3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.798279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.798257    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sd4f\" (UniqueName: \"kubernetes.io/projected/c2792f6c-264d-449d-80a6-2600a087def3-kube-api-access-5sd4f\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4972ls\" (UID: \"c2792f6c-264d-449d-80a6-2600a087def3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.818151 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.818111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:13.925501 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.925455    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:13.956192 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.956155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:13.970005 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.969972    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"]
Jul 14 16:31:13.972622 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:31:13.972593    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03b1f08_627a_4b79_89b1_b0a501e04c1d.slice/crio-1795ab5869138366be11e7fa0b3636e566f226b1ddc4b1d1f405d36050cd3c19 WatchSource:0}: Error finding container 1795ab5869138366be11e7fa0b3636e566f226b1ddc4b1d1f405d36050cd3c19: Status 404 returned error can't find the container with id 1795ab5869138366be11e7fa0b3636e566f226b1ddc4b1d1f405d36050cd3c19
Jul 14 16:31:13.975251 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:13.975229    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:31:14.125337 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:14.125310    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"]
Jul 14 16:31:14.127999 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:31:14.127958    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2792f6c_264d_449d_80a6_2600a087def3.slice/crio-66fd00fd9f4bd0641485cee07e1d4b0e2a358cefd8e4d6c9be0548af1ecfb02a WatchSource:0}: Error finding container 66fd00fd9f4bd0641485cee07e1d4b0e2a358cefd8e4d6c9be0548af1ecfb02a: Status 404 returned error can't find the container with id 66fd00fd9f4bd0641485cee07e1d4b0e2a358cefd8e4d6c9be0548af1ecfb02a
Jul 14 16:31:14.173092 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:14.173053    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:14.274611 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:14.274572    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:14.928464 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:14.928419    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm" event={"ID":"d03b1f08-627a-4b79-89b1-b0a501e04c1d","Type":"ContainerStarted","Data":"1795ab5869138366be11e7fa0b3636e566f226b1ddc4b1d1f405d36050cd3c19"}
Jul 14 16:31:14.930263 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:14.930228    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls" event={"ID":"c2792f6c-264d-449d-80a6-2600a087def3","Type":"ContainerStarted","Data":"66fd00fd9f4bd0641485cee07e1d4b0e2a358cefd8e4d6c9be0548af1ecfb02a"}
Jul 14 16:31:15.413811 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.413677    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:15.479817 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.477010    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"]
Jul 14 16:31:15.482816 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.481535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:15.485653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.485626    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hq6rx\""
Jul 14 16:31:15.486547 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.486512    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 14 16:31:15.490516 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.490241    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"]
Jul 14 16:31:15.525186 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.525119    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:15.591560 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.591523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dbe4b9e-4659-411b-a2c7-4066629d71f3-cert\") pod \"kserve-controller-manager-d6f4b65b8-h2tnf\" (UID: \"9dbe4b9e-4659-411b-a2c7-4066629d71f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:15.591821 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.591567    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npbrc\" (UniqueName: \"kubernetes.io/projected/9dbe4b9e-4659-411b-a2c7-4066629d71f3-kube-api-access-npbrc\") pod \"kserve-controller-manager-d6f4b65b8-h2tnf\" (UID: \"9dbe4b9e-4659-411b-a2c7-4066629d71f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:15.692628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.692533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dbe4b9e-4659-411b-a2c7-4066629d71f3-cert\") pod \"kserve-controller-manager-d6f4b65b8-h2tnf\" (UID: \"9dbe4b9e-4659-411b-a2c7-4066629d71f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:15.692628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.692587    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npbrc\" (UniqueName: \"kubernetes.io/projected/9dbe4b9e-4659-411b-a2c7-4066629d71f3-kube-api-access-npbrc\") pod \"kserve-controller-manager-d6f4b65b8-h2tnf\" (UID: \"9dbe4b9e-4659-411b-a2c7-4066629d71f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:15.693188 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:31:15.693030    2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 14 16:31:15.693188 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:31:15.693100    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dbe4b9e-4659-411b-a2c7-4066629d71f3-cert podName:9dbe4b9e-4659-411b-a2c7-4066629d71f3 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:16.193078127 +0000 UTC m=+309.972242047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9dbe4b9e-4659-411b-a2c7-4066629d71f3-cert") pod "kserve-controller-manager-d6f4b65b8-h2tnf" (UID: "9dbe4b9e-4659-411b-a2c7-4066629d71f3") : secret "kserve-webhook-server-cert" not found
Jul 14 16:31:15.719358 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.719319    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npbrc\" (UniqueName: \"kubernetes.io/projected/9dbe4b9e-4659-411b-a2c7-4066629d71f3-kube-api-access-npbrc\") pod \"kserve-controller-manager-d6f4b65b8-h2tnf\" (UID: \"9dbe4b9e-4659-411b-a2c7-4066629d71f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:15.922026 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:15.921972    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:16.196745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.196704    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dbe4b9e-4659-411b-a2c7-4066629d71f3-cert\") pod \"kserve-controller-manager-d6f4b65b8-h2tnf\" (UID: \"9dbe4b9e-4659-411b-a2c7-4066629d71f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:16.200050 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.200020    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dbe4b9e-4659-411b-a2c7-4066629d71f3-cert\") pod \"kserve-controller-manager-d6f4b65b8-h2tnf\" (UID: \"9dbe4b9e-4659-411b-a2c7-4066629d71f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:16.206198 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.206154    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:16.401974 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.401930    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:16.733598 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.733564    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"]
Jul 14 16:31:16.734125 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.733829    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9" podUID="336442e4-26fe-4e66-98e2-7f9e8fa629d8" containerName="discovery" containerID="cri-o://c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06" gracePeriod=30
Jul 14 16:31:16.822104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.822067    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:16.923958 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.923913    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-4kzx9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.19:8080/ready\": dial tcp 10.133.0.19:8080: connect: connection refused" start-of-body=
Jul 14 16:31:16.924142 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.923981    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9" podUID="336442e4-26fe-4e66-98e2-7f9e8fa629d8" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.19:8080/ready\": dial tcp 10.133.0.19:8080: connect: connection refused"
Jul 14 16:31:16.959359 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:16.959319    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:17.136340 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.136108    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:31:17.136340 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.136263    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:31:17.136565 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.136350    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:31:17.145674 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.145295    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:31:17.145674 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.145380    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:31:17.145674 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.145446    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:31:17.202564 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.202535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:17.206665 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.206615    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"]
Jul 14 16:31:17.268695 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:31:17.268647    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dbe4b9e_4659_411b_a2c7_4066629d71f3.slice/crio-5b39b007e3d09dad9aa0c533498b2366d4868934f060bdebed9939c6f73adfdb WatchSource:0}: Error finding container 5b39b007e3d09dad9aa0c533498b2366d4868934f060bdebed9939c6f73adfdb: Status 404 returned error can't find the container with id 5b39b007e3d09dad9aa0c533498b2366d4868934f060bdebed9939c6f73adfdb
Jul 14 16:31:17.287849 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.287823    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:17.366506 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.366472    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:17.407592 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.407557    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-cacerts\") pod \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") "
Jul 14 16:31:17.407810 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.407629    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-token\") pod \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") "
Jul 14 16:31:17.407810 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.407690    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/336442e4-26fe-4e66-98e2-7f9e8fa629d8-local-certs\") pod \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") "
Jul 14 16:31:17.407810 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.407735    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsxvr\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-kube-api-access-dsxvr\") pod \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") "
Jul 14 16:31:17.407990 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.407865    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-kubeconfig\") pod \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") "
Jul 14 16:31:17.407990 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.407900    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-dns-cert\") pod \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") "
Jul 14 16:31:17.407990 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.407926    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-ca-configmap\") pod \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\" (UID: \"336442e4-26fe-4e66-98e2-7f9e8fa629d8\") "
Jul 14 16:31:17.408682 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.408647    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "336442e4-26fe-4e66-98e2-7f9e8fa629d8" (UID: "336442e4-26fe-4e66-98e2-7f9e8fa629d8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:31:17.410712 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.410660    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "336442e4-26fe-4e66-98e2-7f9e8fa629d8" (UID: "336442e4-26fe-4e66-98e2-7f9e8fa629d8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:31:17.410712 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.410678    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-kube-api-access-dsxvr" (OuterVolumeSpecName: "kube-api-access-dsxvr") pod "336442e4-26fe-4e66-98e2-7f9e8fa629d8" (UID: "336442e4-26fe-4e66-98e2-7f9e8fa629d8"). InnerVolumeSpecName "kube-api-access-dsxvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:31:17.411022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.410928    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-cacerts" (OuterVolumeSpecName: "cacerts") pod "336442e4-26fe-4e66-98e2-7f9e8fa629d8" (UID: "336442e4-26fe-4e66-98e2-7f9e8fa629d8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:31:17.411022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.410993    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/336442e4-26fe-4e66-98e2-7f9e8fa629d8-local-certs" (OuterVolumeSpecName: "local-certs") pod "336442e4-26fe-4e66-98e2-7f9e8fa629d8" (UID: "336442e4-26fe-4e66-98e2-7f9e8fa629d8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:31:17.411173 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.411154    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "336442e4-26fe-4e66-98e2-7f9e8fa629d8" (UID: "336442e4-26fe-4e66-98e2-7f9e8fa629d8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:31:17.412541 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.412523    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "336442e4-26fe-4e66-98e2-7f9e8fa629d8" (UID: "336442e4-26fe-4e66-98e2-7f9e8fa629d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:31:17.509040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.509009    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:17.509040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.509035    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/336442e4-26fe-4e66-98e2-7f9e8fa629d8-local-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:17.509040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.509045    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsxvr\" (UniqueName: \"kubernetes.io/projected/336442e4-26fe-4e66-98e2-7f9e8fa629d8-kube-api-access-dsxvr\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:17.509322 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.509054    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-kubeconfig\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:17.509322 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.509064    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-dns-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:17.509322 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.509072    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/336442e4-26fe-4e66-98e2-7f9e8fa629d8-istio-csr-ca-configmap\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:17.509322 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.509080    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/336442e4-26fe-4e66-98e2-7f9e8fa629d8-cacerts\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:17.946154 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.946118    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm" event={"ID":"d03b1f08-627a-4b79-89b1-b0a501e04c1d","Type":"ContainerStarted","Data":"3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b"}
Jul 14 16:31:17.947653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.947624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls" event={"ID":"c2792f6c-264d-449d-80a6-2600a087def3","Type":"ContainerStarted","Data":"81482385db661de53dd08560abcdcb416b40a746125ea28f9770bf227a2fb1d0"}
Jul 14 16:31:17.948741 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.948716    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf" event={"ID":"9dbe4b9e-4659-411b-a2c7-4066629d71f3","Type":"ContainerStarted","Data":"5b39b007e3d09dad9aa0c533498b2366d4868934f060bdebed9939c6f73adfdb"}
Jul 14 16:31:17.949943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.949917    2574 generic.go:356] "Generic (PLEG): container finished" podID="336442e4-26fe-4e66-98e2-7f9e8fa629d8" containerID="c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06" exitCode=0
Jul 14 16:31:17.950037 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.949962    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"
Jul 14 16:31:17.950037 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.949971    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9" event={"ID":"336442e4-26fe-4e66-98e2-7f9e8fa629d8","Type":"ContainerDied","Data":"c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06"}
Jul 14 16:31:17.950037 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.950013    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9" event={"ID":"336442e4-26fe-4e66-98e2-7f9e8fa629d8","Type":"ContainerDied","Data":"857478373ffa79234554ffb457c966f48d71a55706f4b066632d23dcce752aba"}
Jul 14 16:31:17.950138 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.950039    2574 scope.go:117] "RemoveContainer" containerID="c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06"
Jul 14 16:31:17.956728 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.956706    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:17.958706 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.958689    2574 scope.go:117] "RemoveContainer" containerID="c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06"
Jul 14 16:31:17.959061 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:31:17.959041    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06\": container with ID starting with c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06 not found: ID does not exist" containerID="c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06"
Jul 14 16:31:17.959114 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.959071    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06"} err="failed to get container status \"c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06\": rpc error: code = NotFound desc = could not find container \"c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06\": container with ID starting with c4861159a949c9678e067185b7d5dada4ac0ed64e33a47ee7b751313de71fa06 not found: ID does not exist"
Jul 14 16:31:17.975851 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:17.975760    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm" podStartSLOduration=1.815567498 podStartE2EDuration="4.975742803s" totalImagesPullingTime="3.160175305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:17.97450275 +0000 UTC m=+311.753666685" watchObservedRunningTime="2026-07-14 16:31:17.975742803 +0000 UTC m=+311.754906739"
Jul 14 16:31:18.053152 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:18.053101    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls" podStartSLOduration=2.038088416 podStartE2EDuration="5.053082215s" totalImagesPullingTime="3.014993799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:18.011285633 +0000 UTC m=+311.790449569" watchObservedRunningTime="2026-07-14 16:31:18.053082215 +0000 UTC m=+311.832246155"
Jul 14 16:31:18.054355 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:18.054331    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"]
Jul 14 16:31:18.058937 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:18.058910    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4kzx9"]
Jul 14 16:31:18.756167 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:18.756129    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="336442e4-26fe-4e66-98e2-7f9e8fa629d8" path="/var/lib/kubelet/pods/336442e4-26fe-4e66-98e2-7f9e8fa629d8/volumes"
Jul 14 16:31:18.818591 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:18.818556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:18.820200 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:18.820167    2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Jul 14 16:31:18.820341 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:18.820234    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm" podUID="d03b1f08-627a-4b79-89b1-b0a501e04c1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Jul 14 16:31:18.962098 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:18.962070    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:19.818822 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:19.818754    2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Jul 14 16:31:19.819011 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:19.818854    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm" podUID="d03b1f08-627a-4b79-89b1-b0a501e04c1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Jul 14 16:31:19.959148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:19.959109    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:19.960371 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:19.960255    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4972ls"
Jul 14 16:31:20.072576 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:20.072488    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"]
Jul 14 16:31:20.818998 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:20.818962    2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Jul 14 16:31:20.819197 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:20.819027    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm" podUID="d03b1f08-627a-4b79-89b1-b0a501e04c1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Jul 14 16:31:20.964274 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:20.964214    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf" event={"ID":"9dbe4b9e-4659-411b-a2c7-4066629d71f3","Type":"ContainerStarted","Data":"0db461f045d05f266938989ae3ecace156010e83680aecc24af3b9bcaa8163d3"}
Jul 14 16:31:20.964558 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:20.964538    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:20.964679 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:20.964556    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm" podUID="d03b1f08-627a-4b79-89b1-b0a501e04c1d" containerName="istio-proxy" containerID="cri-o://3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b" gracePeriod=30
Jul 14 16:31:20.982691 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:20.982635    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf" podStartSLOduration=3.2142261579999998 podStartE2EDuration="5.982617925s" totalImagesPullingTime="2.768391767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:20.982268418 +0000 UTC m=+314.761432355" watchObservedRunningTime="2026-07-14 16:31:20.982617925 +0000 UTC m=+314.761781861"
Jul 14 16:31:23.925416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:23.925378    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lbzw2"
Jul 14 16:31:23.928611 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:23.928588    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zcb4j"
Jul 14 16:31:26.207182 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.207149    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:26.291856 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.291816    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-envoy\") pod \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") "
Jul 14 16:31:26.292021 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.291882    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istiod-ca-cert\") pod \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") "
Jul 14 16:31:26.292021 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.291919    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89gwt\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-kube-api-access-89gwt\") pod \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") "
Jul 14 16:31:26.292021 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.291952    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-socket\") pod \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") "
Jul 14 16:31:26.292021 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.291984    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-podinfo\") pod \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") "
Jul 14 16:31:26.292247 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292035    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-data\") pod \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") "
Jul 14 16:31:26.292247 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292059    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-certs\") pod \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") "
Jul 14 16:31:26.292357 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292288    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d03b1f08-627a-4b79-89b1-b0a501e04c1d" (UID: "d03b1f08-627a-4b79-89b1-b0a501e04c1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:31:26.292357 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292299    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-token\") pod \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") "
Jul 14 16:31:26.292357 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292322    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d03b1f08-627a-4b79-89b1-b0a501e04c1d" (UID: "d03b1f08-627a-4b79-89b1-b0a501e04c1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:31:26.292494 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292369    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-credential-socket\") pod \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\" (UID: \"d03b1f08-627a-4b79-89b1-b0a501e04c1d\") "
Jul 14 16:31:26.292494 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292444    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d03b1f08-627a-4b79-89b1-b0a501e04c1d" (UID: "d03b1f08-627a-4b79-89b1-b0a501e04c1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:31:26.292647 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292606    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:26.292647 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292628    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-data\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:26.292647 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292644    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-workload-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:26.292942 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292676    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d03b1f08-627a-4b79-89b1-b0a501e04c1d" (UID: "d03b1f08-627a-4b79-89b1-b0a501e04c1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:31:26.292942 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.292684    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d03b1f08-627a-4b79-89b1-b0a501e04c1d" (UID: "d03b1f08-627a-4b79-89b1-b0a501e04c1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:31:26.294413 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.294384    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-kube-api-access-89gwt" (OuterVolumeSpecName: "kube-api-access-89gwt") pod "d03b1f08-627a-4b79-89b1-b0a501e04c1d" (UID: "d03b1f08-627a-4b79-89b1-b0a501e04c1d"). InnerVolumeSpecName "kube-api-access-89gwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:31:26.294879 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.294848    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d03b1f08-627a-4b79-89b1-b0a501e04c1d" (UID: "d03b1f08-627a-4b79-89b1-b0a501e04c1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:31:26.295006 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.294947    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d03b1f08-627a-4b79-89b1-b0a501e04c1d" (UID: "d03b1f08-627a-4b79-89b1-b0a501e04c1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:31:26.295006 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.294969    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d03b1f08-627a-4b79-89b1-b0a501e04c1d" (UID: "d03b1f08-627a-4b79-89b1-b0a501e04c1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:31:26.393215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.393171    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:26.393215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.393203    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-credential-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:26.393215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.393212    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-envoy\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:26.393215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.393221    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istiod-ca-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:26.393215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.393229    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89gwt\" (UniqueName: \"kubernetes.io/projected/d03b1f08-627a-4b79-89b1-b0a501e04c1d-kube-api-access-89gwt\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:26.393604 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.393237    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03b1f08-627a-4b79-89b1-b0a501e04c1d-istio-podinfo\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:31:26.991065 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.991022    2574 generic.go:356] "Generic (PLEG): container finished" podID="d03b1f08-627a-4b79-89b1-b0a501e04c1d" containerID="3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b" exitCode=0
Jul 14 16:31:26.991267 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.991093    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"
Jul 14 16:31:26.991267 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.991106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm" event={"ID":"d03b1f08-627a-4b79-89b1-b0a501e04c1d","Type":"ContainerDied","Data":"3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b"}
Jul 14 16:31:26.991267 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.991165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm" event={"ID":"d03b1f08-627a-4b79-89b1-b0a501e04c1d","Type":"ContainerDied","Data":"1795ab5869138366be11e7fa0b3636e566f226b1ddc4b1d1f405d36050cd3c19"}
Jul 14 16:31:26.991267 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.991186    2574 scope.go:117] "RemoveContainer" containerID="3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b"
Jul 14 16:31:26.999672 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.999649    2574 scope.go:117] "RemoveContainer" containerID="3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b"
Jul 14 16:31:26.999984 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:31:26.999963    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b\": container with ID starting with 3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b not found: ID does not exist" containerID="3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b"
Jul 14 16:31:27.000044 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:26.999993    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b"} err="failed to get container status \"3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b\": rpc error: code = NotFound desc = could not find container \"3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b\": container with ID starting with 3787f1c32b83e3dbdeb54c6d332ae5420f9d49ffd52103d7db7883048296fa2b not found: ID does not exist"
Jul 14 16:31:27.010524 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:27.010489    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"]
Jul 14 16:31:27.013496 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:27.013468    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wfpwm"]
Jul 14 16:31:28.755597 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:28.755562    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d03b1f08-627a-4b79-89b1-b0a501e04c1d" path="/var/lib/kubelet/pods/d03b1f08-627a-4b79-89b1-b0a501e04c1d/volumes"
Jul 14 16:31:52.977733 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:52.977702    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h2tnf"
Jul 14 16:31:55.113971 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:55.113923    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:57.615757 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:31:57.615663    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:05.266502 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.266457    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:05.359331 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.359243    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:05.389439 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.389398    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74mwj"]
Jul 14 16:32:05.389745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.389731    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d03b1f08-627a-4b79-89b1-b0a501e04c1d" containerName="istio-proxy"
Jul 14 16:32:05.389815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.389747    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03b1f08-627a-4b79-89b1-b0a501e04c1d" containerName="istio-proxy"
Jul 14 16:32:05.389815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.389765    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336442e4-26fe-4e66-98e2-7f9e8fa629d8" containerName="discovery"
Jul 14 16:32:05.389815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.389771    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="336442e4-26fe-4e66-98e2-7f9e8fa629d8" containerName="discovery"
Jul 14 16:32:05.389912 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.389836    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="336442e4-26fe-4e66-98e2-7f9e8fa629d8" containerName="discovery"
Jul 14 16:32:05.389912 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.389847    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d03b1f08-627a-4b79-89b1-b0a501e04c1d" containerName="istio-proxy"
Jul 14 16:32:05.391945 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.391928    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-74mwj"
Jul 14 16:32:05.394820 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.394770    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 16:32:05.395498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.395474    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-m8nw7\""
Jul 14 16:32:05.395638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.395496    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 16:32:05.408085 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.408052    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74mwj"]
Jul 14 16:32:05.413496 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.413468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clwn6\" (UniqueName: \"kubernetes.io/projected/7e57a549-5dc2-4ab5-b347-a6fa86a727e2-kube-api-access-clwn6\") pod \"kuadrant-operator-catalog-74mwj\" (UID: \"7e57a549-5dc2-4ab5-b347-a6fa86a727e2\") " pod="kuadrant-system/kuadrant-operator-catalog-74mwj"
Jul 14 16:32:05.444247 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.444209    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:05.514327 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.514297    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clwn6\" (UniqueName: \"kubernetes.io/projected/7e57a549-5dc2-4ab5-b347-a6fa86a727e2-kube-api-access-clwn6\") pod \"kuadrant-operator-catalog-74mwj\" (UID: \"7e57a549-5dc2-4ab5-b347-a6fa86a727e2\") " pod="kuadrant-system/kuadrant-operator-catalog-74mwj"
Jul 14 16:32:05.523877 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.523803    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clwn6\" (UniqueName: \"kubernetes.io/projected/7e57a549-5dc2-4ab5-b347-a6fa86a727e2-kube-api-access-clwn6\") pod \"kuadrant-operator-catalog-74mwj\" (UID: \"7e57a549-5dc2-4ab5-b347-a6fa86a727e2\") " pod="kuadrant-system/kuadrant-operator-catalog-74mwj"
Jul 14 16:32:05.703145 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.703103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-74mwj"
Jul 14 16:32:05.755239 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.755208    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74mwj"]
Jul 14 16:32:05.846492 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.846457    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74mwj"]
Jul 14 16:32:05.849514 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:32:05.849490    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e57a549_5dc2_4ab5_b347_a6fa86a727e2.slice/crio-2b3eecbc246e5e275f47fcd723c608b92d1d0445fd44b8a2b8ef152644dc8ae8 WatchSource:0}: Error finding container 2b3eecbc246e5e275f47fcd723c608b92d1d0445fd44b8a2b8ef152644dc8ae8: Status 404 returned error can't find the container with id 2b3eecbc246e5e275f47fcd723c608b92d1d0445fd44b8a2b8ef152644dc8ae8
Jul 14 16:32:05.964831 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.964793    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2nnk8"]
Jul 14 16:32:05.967539 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.967508    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2nnk8"
Jul 14 16:32:05.977625 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:05.977597    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2nnk8"]
Jul 14 16:32:06.017559 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:06.017519    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps8lm\" (UniqueName: \"kubernetes.io/projected/0f5ec859-57ad-453a-9c62-e84416aab566-kube-api-access-ps8lm\") pod \"kuadrant-operator-catalog-2nnk8\" (UID: \"0f5ec859-57ad-453a-9c62-e84416aab566\") " pod="kuadrant-system/kuadrant-operator-catalog-2nnk8"
Jul 14 16:32:06.118171 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:06.118081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8lm\" (UniqueName: \"kubernetes.io/projected/0f5ec859-57ad-453a-9c62-e84416aab566-kube-api-access-ps8lm\") pod \"kuadrant-operator-catalog-2nnk8\" (UID: \"0f5ec859-57ad-453a-9c62-e84416aab566\") " pod="kuadrant-system/kuadrant-operator-catalog-2nnk8"
Jul 14 16:32:06.127237 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:06.127211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps8lm\" (UniqueName: \"kubernetes.io/projected/0f5ec859-57ad-453a-9c62-e84416aab566-kube-api-access-ps8lm\") pod \"kuadrant-operator-catalog-2nnk8\" (UID: \"0f5ec859-57ad-453a-9c62-e84416aab566\") " pod="kuadrant-system/kuadrant-operator-catalog-2nnk8"
Jul 14 16:32:06.149743 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:06.149709    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-74mwj" event={"ID":"7e57a549-5dc2-4ab5-b347-a6fa86a727e2","Type":"ContainerStarted","Data":"2b3eecbc246e5e275f47fcd723c608b92d1d0445fd44b8a2b8ef152644dc8ae8"}
Jul 14 16:32:06.198031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:06.197986    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:06.277164 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:06.277121    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2nnk8"
Jul 14 16:32:06.407006 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:06.406907    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:06.416009 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:06.415980    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2nnk8"]
Jul 14 16:32:06.418991 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:32:06.418944    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5ec859_57ad_453a_9c62_e84416aab566.slice/crio-aeb89fc435b033f680c3fdd6d228c17a6b9985b5e7e646c1c337a37cdfe135ab WatchSource:0}: Error finding container aeb89fc435b033f680c3fdd6d228c17a6b9985b5e7e646c1c337a37cdfe135ab: Status 404 returned error can't find the container with id aeb89fc435b033f680c3fdd6d228c17a6b9985b5e7e646c1c337a37cdfe135ab
Jul 14 16:32:07.155062 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:07.155024    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2nnk8" event={"ID":"0f5ec859-57ad-453a-9c62-e84416aab566","Type":"ContainerStarted","Data":"aeb89fc435b033f680c3fdd6d228c17a6b9985b5e7e646c1c337a37cdfe135ab"}
Jul 14 16:32:10.170640 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:10.170553    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2nnk8" event={"ID":"0f5ec859-57ad-453a-9c62-e84416aab566","Type":"ContainerStarted","Data":"ffef9d48d2210a41a698ad1b92da358861c2704fdd64a20e3f558038f0ddf40e"}
Jul 14 16:32:10.187484 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:10.187424    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2nnk8" podStartSLOduration=1.782822841 podStartE2EDuration="5.187403917s" totalImagesPullingTime="3.404581076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:32:10.186707086 +0000 UTC m=+363.965871034" watchObservedRunningTime="2026-07-14 16:32:10.187403917 +0000 UTC m=+363.966567853"
Jul 14 16:32:11.175798 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:11.175753    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-74mwj" event={"ID":"7e57a549-5dc2-4ab5-b347-a6fa86a727e2","Type":"ContainerStarted","Data":"8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447"}
Jul 14 16:32:11.176228 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:11.175881    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-74mwj" podUID="7e57a549-5dc2-4ab5-b347-a6fa86a727e2" containerName="registry-server" containerID="cri-o://8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447" gracePeriod=2
Jul 14 16:32:11.195657 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:11.195603    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-74mwj" podStartSLOduration=1.72020927 podStartE2EDuration="6.195585257s" totalImagesPullingTime="4.475375987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:32:11.193620447 +0000 UTC m=+364.972784382" watchObservedRunningTime="2026-07-14 16:32:11.195585257 +0000 UTC m=+364.974749198"
Jul 14 16:32:11.432731 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:11.432660    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-74mwj"
Jul 14 16:32:11.463481 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:11.463446    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clwn6\" (UniqueName: \"kubernetes.io/projected/7e57a549-5dc2-4ab5-b347-a6fa86a727e2-kube-api-access-clwn6\") pod \"7e57a549-5dc2-4ab5-b347-a6fa86a727e2\" (UID: \"7e57a549-5dc2-4ab5-b347-a6fa86a727e2\") "
Jul 14 16:32:11.465955 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:11.465918    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e57a549-5dc2-4ab5-b347-a6fa86a727e2-kube-api-access-clwn6" (OuterVolumeSpecName: "kube-api-access-clwn6") pod "7e57a549-5dc2-4ab5-b347-a6fa86a727e2" (UID: "7e57a549-5dc2-4ab5-b347-a6fa86a727e2"). InnerVolumeSpecName "kube-api-access-clwn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:32:11.564012 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:11.563972    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clwn6\" (UniqueName: \"kubernetes.io/projected/7e57a549-5dc2-4ab5-b347-a6fa86a727e2-kube-api-access-clwn6\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:32:12.181045 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.181009    2574 generic.go:356] "Generic (PLEG): container finished" podID="7e57a549-5dc2-4ab5-b347-a6fa86a727e2" containerID="8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447" exitCode=0
Jul 14 16:32:12.181471 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.181053    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-74mwj"
Jul 14 16:32:12.181471 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.181097    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-74mwj" event={"ID":"7e57a549-5dc2-4ab5-b347-a6fa86a727e2","Type":"ContainerDied","Data":"8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447"}
Jul 14 16:32:12.181471 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.181151    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-74mwj" event={"ID":"7e57a549-5dc2-4ab5-b347-a6fa86a727e2","Type":"ContainerDied","Data":"2b3eecbc246e5e275f47fcd723c608b92d1d0445fd44b8a2b8ef152644dc8ae8"}
Jul 14 16:32:12.181471 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.181175    2574 scope.go:117] "RemoveContainer" containerID="8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447"
Jul 14 16:32:12.189922 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.189833    2574 scope.go:117] "RemoveContainer" containerID="8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447"
Jul 14 16:32:12.190144 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:32:12.190123    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447\": container with ID starting with 8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447 not found: ID does not exist" containerID="8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447"
Jul 14 16:32:12.190192 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.190155    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447"} err="failed to get container status \"8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447\": rpc error: code = NotFound desc = could not find container \"8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447\": container with ID starting with 8d2d6f07b5ce5f8b8619b0aff6b1932b72ffb5dc569aabfa7600d6338478b447 not found: ID does not exist"
Jul 14 16:32:12.202775 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.202739    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74mwj"]
Jul 14 16:32:12.207675 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.207648    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74mwj"]
Jul 14 16:32:12.755714 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:12.755679    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e57a549-5dc2-4ab5-b347-a6fa86a727e2" path="/var/lib/kubelet/pods/7e57a549-5dc2-4ab5-b347-a6fa86a727e2/volumes"
Jul 14 16:32:16.277904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:16.277860    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2nnk8"
Jul 14 16:32:16.278335 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:16.277922    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2nnk8"
Jul 14 16:32:16.300663 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:16.300637    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2nnk8"
Jul 14 16:32:17.224226 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:17.224196    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2nnk8"
Jul 14 16:32:35.783351 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:35.783281    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:38.414706 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.414668    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"]
Jul 14 16:32:38.415126 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.415056    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e57a549-5dc2-4ab5-b347-a6fa86a727e2" containerName="registry-server"
Jul 14 16:32:38.415126 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.415072    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e57a549-5dc2-4ab5-b347-a6fa86a727e2" containerName="registry-server"
Jul 14 16:32:38.415194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.415131    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e57a549-5dc2-4ab5-b347-a6fa86a727e2" containerName="registry-server"
Jul 14 16:32:38.419254 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.419232    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"
Jul 14 16:32:38.422934 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.422910    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qnpcx\""
Jul 14 16:32:38.422934 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.422918    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 14 16:32:38.435377 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.435346    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"]
Jul 14 16:32:38.597991 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.597944    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2tjx\" (UniqueName: \"kubernetes.io/projected/111c4ad0-e4bd-4f91-868e-810b154bcbb2-kube-api-access-t2tjx\") pod \"dns-operator-controller-manager-864dd78c4c-9hmzd\" (UID: \"111c4ad0-e4bd-4f91-868e-810b154bcbb2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"
Jul 14 16:32:38.698473 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.698372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2tjx\" (UniqueName: \"kubernetes.io/projected/111c4ad0-e4bd-4f91-868e-810b154bcbb2-kube-api-access-t2tjx\") pod \"dns-operator-controller-manager-864dd78c4c-9hmzd\" (UID: \"111c4ad0-e4bd-4f91-868e-810b154bcbb2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"
Jul 14 16:32:38.709370 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.709330    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2tjx\" (UniqueName: \"kubernetes.io/projected/111c4ad0-e4bd-4f91-868e-810b154bcbb2-kube-api-access-t2tjx\") pod \"dns-operator-controller-manager-864dd78c4c-9hmzd\" (UID: \"111c4ad0-e4bd-4f91-868e-810b154bcbb2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"
Jul 14 16:32:38.729146 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.729105    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"
Jul 14 16:32:38.875061 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:38.875036    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"]
Jul 14 16:32:38.877859 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:32:38.877832    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111c4ad0_e4bd_4f91_868e_810b154bcbb2.slice/crio-83a7e47bdcddb8345e64eed8f29c6d4cff5119d5ff8bdb44b676e49f37335f03 WatchSource:0}: Error finding container 83a7e47bdcddb8345e64eed8f29c6d4cff5119d5ff8bdb44b676e49f37335f03: Status 404 returned error can't find the container with id 83a7e47bdcddb8345e64eed8f29c6d4cff5119d5ff8bdb44b676e49f37335f03
Jul 14 16:32:39.180773 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:39.180740    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:39.291142 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:39.291108    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd" event={"ID":"111c4ad0-e4bd-4f91-868e-810b154bcbb2","Type":"ContainerStarted","Data":"83a7e47bdcddb8345e64eed8f29c6d4cff5119d5ff8bdb44b676e49f37335f03"}
Jul 14 16:32:40.069584 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:40.069545    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:40.420669 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:40.420577    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:40.528529 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:40.528481    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:42.308140 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.308107    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd" event={"ID":"111c4ad0-e4bd-4f91-868e-810b154bcbb2","Type":"ContainerStarted","Data":"37af6ead420ee8c5d0117e1f01eab1f18d8a20be53d43305a68fcc5c6f4fb727"}
Jul 14 16:32:42.308525 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.308207    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"
Jul 14 16:32:42.332298 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.332239    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd" podStartSLOduration=1.7995072479999998 podStartE2EDuration="4.332223351s" totalImagesPullingTime="2.532716103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:32:42.331300164 +0000 UTC m=+396.110464081" watchObservedRunningTime="2026-07-14 16:32:42.332223351 +0000 UTC m=+396.111387287"
Jul 14 16:32:42.494567 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.494531    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-khss8"]
Jul 14 16:32:42.498965 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.498097    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8"
Jul 14 16:32:42.500991 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.500968    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-t98qk\""
Jul 14 16:32:42.512587 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.512557    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-khss8"]
Jul 14 16:32:42.630610 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.630513    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlpf4\" (UniqueName: \"kubernetes.io/projected/dd46c44d-cc9e-459d-8c08-01d782cfe73e-kube-api-access-xlpf4\") pod \"authorino-operator-75cc8d5cb7-khss8\" (UID: \"dd46c44d-cc9e-459d-8c08-01d782cfe73e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8"
Jul 14 16:32:42.731539 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.731496    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlpf4\" (UniqueName: \"kubernetes.io/projected/dd46c44d-cc9e-459d-8c08-01d782cfe73e-kube-api-access-xlpf4\") pod \"authorino-operator-75cc8d5cb7-khss8\" (UID: \"dd46c44d-cc9e-459d-8c08-01d782cfe73e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8"
Jul 14 16:32:42.745836 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.745809    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlpf4\" (UniqueName: \"kubernetes.io/projected/dd46c44d-cc9e-459d-8c08-01d782cfe73e-kube-api-access-xlpf4\") pod \"authorino-operator-75cc8d5cb7-khss8\" (UID: \"dd46c44d-cc9e-459d-8c08-01d782cfe73e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8"
Jul 14 16:32:42.809468 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.809426    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8"
Jul 14 16:32:42.947696 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.947518    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-khss8"]
Jul 14 16:32:42.950373 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:32:42.950334    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd46c44d_cc9e_459d_8c08_01d782cfe73e.slice/crio-c021bc1dc6f27bb8fdfd4d7b1ef8f9e70d426165a45f65228e8a8411cb56780a WatchSource:0}: Error finding container c021bc1dc6f27bb8fdfd4d7b1ef8f9e70d426165a45f65228e8a8411cb56780a: Status 404 returned error can't find the container with id c021bc1dc6f27bb8fdfd4d7b1ef8f9e70d426165a45f65228e8a8411cb56780a
Jul 14 16:32:42.976912 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:42.976872    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:43.313468 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:43.313428    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8" event={"ID":"dd46c44d-cc9e-459d-8c08-01d782cfe73e","Type":"ContainerStarted","Data":"c021bc1dc6f27bb8fdfd4d7b1ef8f9e70d426165a45f65228e8a8411cb56780a"}
Jul 14 16:32:43.836586 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:43.836482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:43.982405 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:43.982366    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:45.865852 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:45.865769    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:46.330549 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:46.330505    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8" event={"ID":"dd46c44d-cc9e-459d-8c08-01d782cfe73e","Type":"ContainerStarted","Data":"a83eacf8738c74226250c7cc4d8830233cd527468cc12d46ccca4e58095d5bcc"}
Jul 14 16:32:46.330835 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:46.330668    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8"
Jul 14 16:32:46.352427 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:46.352370    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8" podStartSLOduration=1.9735493800000001 podStartE2EDuration="4.35235167s" totalImagesPullingTime="2.37880229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:32:46.350292354 +0000 UTC m=+400.129456291" watchObservedRunningTime="2026-07-14 16:32:46.35235167 +0000 UTC m=+400.131515605"
Jul 14 16:32:47.105515 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.105480    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:47.128192 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.128150    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"]
Jul 14 16:32:47.131653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.131625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:32:47.135238 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.135217    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nxb7q\""
Jul 14 16:32:47.159555 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.159518    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"]
Jul 14 16:32:47.168045 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.168002    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc216f2-2b2b-4824-95b4-0042acd1871a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" (UID: \"6cc216f2-2b2b-4824-95b4-0042acd1871a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:32:47.168220 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.168103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl2zv\" (UniqueName: \"kubernetes.io/projected/6cc216f2-2b2b-4824-95b4-0042acd1871a-kube-api-access-gl2zv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" (UID: \"6cc216f2-2b2b-4824-95b4-0042acd1871a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:32:47.269322 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.269287    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc216f2-2b2b-4824-95b4-0042acd1871a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" (UID: \"6cc216f2-2b2b-4824-95b4-0042acd1871a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:32:47.269490 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.269342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl2zv\" (UniqueName: \"kubernetes.io/projected/6cc216f2-2b2b-4824-95b4-0042acd1871a-kube-api-access-gl2zv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" (UID: \"6cc216f2-2b2b-4824-95b4-0042acd1871a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:32:47.269665 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.269645    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc216f2-2b2b-4824-95b4-0042acd1871a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" (UID: \"6cc216f2-2b2b-4824-95b4-0042acd1871a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:32:47.291885 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.291848    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl2zv\" (UniqueName: \"kubernetes.io/projected/6cc216f2-2b2b-4824-95b4-0042acd1871a-kube-api-access-gl2zv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" (UID: \"6cc216f2-2b2b-4824-95b4-0042acd1871a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:32:47.442237 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.442141    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:32:47.598060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:47.598026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"]
Jul 14 16:32:47.600560 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:32:47.600533    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc216f2_2b2b_4824_95b4_0042acd1871a.slice/crio-875504150f7f865fc2d478e1521478cc02db4e941f9605c0b983887cfef8748c WatchSource:0}: Error finding container 875504150f7f865fc2d478e1521478cc02db4e941f9605c0b983887cfef8748c: Status 404 returned error can't find the container with id 875504150f7f865fc2d478e1521478cc02db4e941f9605c0b983887cfef8748c
Jul 14 16:32:48.340058 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:48.340023    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w" event={"ID":"6cc216f2-2b2b-4824-95b4-0042acd1871a","Type":"ContainerStarted","Data":"875504150f7f865fc2d478e1521478cc02db4e941f9605c0b983887cfef8748c"}
Jul 14 16:32:49.508540 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:49.508505    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:49.648305 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:49.648267    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:50.291862 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:50.291825    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"]
Jul 14 16:32:50.295412 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:50.295379    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:32:50.298469 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:50.298437    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6wcr2\""
Jul 14 16:32:50.314877 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:50.314839    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"]
Jul 14 16:32:50.395446 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:50.395403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h75t2\" (UniqueName: \"kubernetes.io/projected/4f508db6-3dfe-4f60-a15e-9b51e8f72d1e-kube-api-access-h75t2\") pod \"limitador-operator-controller-manager-859d7b78bd-vvzs5\" (UID: \"4f508db6-3dfe-4f60-a15e-9b51e8f72d1e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:32:50.496854 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:50.496812    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h75t2\" (UniqueName: \"kubernetes.io/projected/4f508db6-3dfe-4f60-a15e-9b51e8f72d1e-kube-api-access-h75t2\") pod \"limitador-operator-controller-manager-859d7b78bd-vvzs5\" (UID: \"4f508db6-3dfe-4f60-a15e-9b51e8f72d1e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:32:50.513635 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:50.513597    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h75t2\" (UniqueName: \"kubernetes.io/projected/4f508db6-3dfe-4f60-a15e-9b51e8f72d1e-kube-api-access-h75t2\") pod \"limitador-operator-controller-manager-859d7b78bd-vvzs5\" (UID: \"4f508db6-3dfe-4f60-a15e-9b51e8f72d1e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:32:50.607906 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:50.607816    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:32:50.770546 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:50.770518    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"]
Jul 14 16:32:50.772588 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:32:50.772553    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f508db6_3dfe_4f60_a15e_9b51e8f72d1e.slice/crio-8f2389522b35d37e2e6ca47f6223259af2ff1234ae6cb8ef0cd405e4d10add21 WatchSource:0}: Error finding container 8f2389522b35d37e2e6ca47f6223259af2ff1234ae6cb8ef0cd405e4d10add21: Status 404 returned error can't find the container with id 8f2389522b35d37e2e6ca47f6223259af2ff1234ae6cb8ef0cd405e4d10add21
Jul 14 16:32:51.340372 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:51.340324    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:51.356379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:51.356318    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5" event={"ID":"4f508db6-3dfe-4f60-a15e-9b51e8f72d1e","Type":"ContainerStarted","Data":"8f2389522b35d37e2e6ca47f6223259af2ff1234ae6cb8ef0cd405e4d10add21"}
Jul 14 16:32:51.440285 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:51.440247    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:51.580722 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:51.580687    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:51.707493 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:51.707410    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:53.316238 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:53.316207    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmzd"
Jul 14 16:32:53.368416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:53.368365    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5" event={"ID":"4f508db6-3dfe-4f60-a15e-9b51e8f72d1e","Type":"ContainerStarted","Data":"34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a"}
Jul 14 16:32:53.368602 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:53.368441    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:32:53.389711 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:53.389646    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5" podStartSLOduration=1.355130538 podStartE2EDuration="3.389622339s" totalImagesPullingTime="2.034491801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:32:53.388005755 +0000 UTC m=+407.167169692" watchObservedRunningTime="2026-07-14 16:32:53.389622339 +0000 UTC m=+407.168786275"
Jul 14 16:32:55.380085 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:55.380049    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w" event={"ID":"6cc216f2-2b2b-4824-95b4-0042acd1871a","Type":"ContainerStarted","Data":"5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128"}
Jul 14 16:32:55.380569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:55.380265    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:32:55.405483 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:55.405424    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w" podStartSLOduration=1.546711793 podStartE2EDuration="8.405404358s" totalImagesPullingTime="6.858692565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:32:55.403174629 +0000 UTC m=+409.182338565" watchObservedRunningTime="2026-07-14 16:32:55.405404358 +0000 UTC m=+409.184568367"
Jul 14 16:32:57.117174 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.117139    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"]
Jul 14 16:32:57.120509 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.120485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.123736 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.123712    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 14 16:32:57.123736 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.123712    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bkx9\""
Jul 14 16:32:57.124006 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.123865    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 14 16:32:57.131933 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.131907    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"]
Jul 14 16:32:57.153055 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.153015    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b0fdf47b-8b1d-4753-8c54-d9c425567467-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.153255 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.153078    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0fdf47b-8b1d-4753-8c54-d9c425567467-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.153255 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.153152    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbgk2\" (UniqueName: \"kubernetes.io/projected/b0fdf47b-8b1d-4753-8c54-d9c425567467-kube-api-access-fbgk2\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.154184 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.154152    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:57.243094 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.243064    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:57.254214 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.254175    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbgk2\" (UniqueName: \"kubernetes.io/projected/b0fdf47b-8b1d-4753-8c54-d9c425567467-kube-api-access-fbgk2\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.254391 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.254234    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b0fdf47b-8b1d-4753-8c54-d9c425567467-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.254391 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.254278    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0fdf47b-8b1d-4753-8c54-d9c425567467-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.254516 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:32:57.254396    2574 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 14 16:32:57.254516 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:32:57.254477    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0fdf47b-8b1d-4753-8c54-d9c425567467-plugin-serving-cert podName:b0fdf47b-8b1d-4753-8c54-d9c425567467 nodeName:}" failed. No retries permitted until 2026-07-14 16:32:57.754454457 +0000 UTC m=+411.533618389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/b0fdf47b-8b1d-4753-8c54-d9c425567467-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-lmrc4" (UID: "b0fdf47b-8b1d-4753-8c54-d9c425567467") : secret "plugin-serving-cert" not found
Jul 14 16:32:57.255016 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.254992    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b0fdf47b-8b1d-4753-8c54-d9c425567467-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.263646 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.263618    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbgk2\" (UniqueName: \"kubernetes.io/projected/b0fdf47b-8b1d-4753-8c54-d9c425567467-kube-api-access-fbgk2\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.336803 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.336749    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khss8"
Jul 14 16:32:57.360114 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.360076    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:57.580467 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.580427    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:57.681028 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.680995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:57.758323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.758282    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0fdf47b-8b1d-4753-8c54-d9c425567467-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:57.761037 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:57.761013    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0fdf47b-8b1d-4753-8c54-d9c425567467-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmrc4\" (UID: \"b0fdf47b-8b1d-4753-8c54-d9c425567467\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:58.030366 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:58.030315    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"
Jul 14 16:32:58.212822 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:58.212798    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4"]
Jul 14 16:32:58.214544 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:32:58.214517    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0fdf47b_8b1d_4753_8c54_d9c425567467.slice/crio-1ff68c274c2a39c749d562b739ad57478ca3ae20dfb0eb917245a32498b18ebf WatchSource:0}: Error finding container 1ff68c274c2a39c749d562b739ad57478ca3ae20dfb0eb917245a32498b18ebf: Status 404 returned error can't find the container with id 1ff68c274c2a39c749d562b739ad57478ca3ae20dfb0eb917245a32498b18ebf
Jul 14 16:32:58.396484 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:32:58.396393    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4" event={"ID":"b0fdf47b-8b1d-4753-8c54-d9c425567467","Type":"ContainerStarted","Data":"1ff68c274c2a39c749d562b739ad57478ca3ae20dfb0eb917245a32498b18ebf"}
Jul 14 16:33:01.219774 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:01.219728    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:01.335705 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:01.335658    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:04.376359 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:04.376329    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:33:06.388820 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:06.388765    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:07.818947 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:07.818909    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:08.049881 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.049822    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:08.518691 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.518655    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"]
Jul 14 16:33:08.518949 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.518919    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" containerName="manager" containerID="cri-o://5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128" gracePeriod=2
Jul 14 16:33:08.553525 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.553490    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"]
Jul 14 16:33:08.574439 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.573963    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"]
Jul 14 16:33:08.574439 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.574245    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" containerName="manager" containerID="cri-o://34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a" gracePeriod=2
Jul 14 16:33:08.584171 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:08.584118    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:08.586375 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.586333    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"]
Jul 14 16:33:08.604058 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.604024    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"]
Jul 14 16:33:08.604405 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.604386    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" containerName="manager"
Jul 14 16:33:08.604405 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.604407    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" containerName="manager"
Jul 14 16:33:08.604553 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.604433    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" containerName="manager"
Jul 14 16:33:08.604553 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.604443    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" containerName="manager"
Jul 14 16:33:08.604553 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.604508    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" containerName="manager"
Jul 14 16:33:08.604553 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.604518    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" containerName="manager"
Jul 14 16:33:08.608897 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.608872    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:08.652514 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.652485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr7lp\" (UniqueName: \"kubernetes.io/projected/4e5a197f-e11a-4610-9915-fe217b2b344b-kube-api-access-kr7lp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxbg\" (UID: \"4e5a197f-e11a-4610-9915-fe217b2b344b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:08.652514 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.652526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5a197f-e11a-4610-9915-fe217b2b344b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxbg\" (UID: \"4e5a197f-e11a-4610-9915-fe217b2b344b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:08.674093 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.674058    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"]
Jul 14 16:33:08.679668 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.679600    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"]
Jul 14 16:33:08.679868 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.679756    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"
Jul 14 16:33:08.705627 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:08.705577    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vvzs5\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:33:08.708121 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:08.708079    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:08.711134 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:08.711100    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vvzs5\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:33:08.731913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.731878    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"]
Jul 14 16:33:08.753572 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.753540    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5a197f-e11a-4610-9915-fe217b2b344b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxbg\" (UID: \"4e5a197f-e11a-4610-9915-fe217b2b344b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:08.753796 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.753647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmkgk\" (UniqueName: \"kubernetes.io/projected/f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f-kube-api-access-qmkgk\") pod \"limitador-operator-controller-manager-859d7b78bd-xgxvl\" (UID: \"f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"
Jul 14 16:33:08.753796 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.753728    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr7lp\" (UniqueName: \"kubernetes.io/projected/4e5a197f-e11a-4610-9915-fe217b2b344b-kube-api-access-kr7lp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxbg\" (UID: \"4e5a197f-e11a-4610-9915-fe217b2b344b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:08.754066 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.754035    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5a197f-e11a-4610-9915-fe217b2b344b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxbg\" (UID: \"4e5a197f-e11a-4610-9915-fe217b2b344b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:08.766423 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:08.766361    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:08.780118 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.780038    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr7lp\" (UniqueName: \"kubernetes.io/projected/4e5a197f-e11a-4610-9915-fe217b2b344b-kube-api-access-kr7lp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgxbg\" (UID: \"4e5a197f-e11a-4610-9915-fe217b2b344b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:08.854589 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.854545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmkgk\" (UniqueName: \"kubernetes.io/projected/f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f-kube-api-access-qmkgk\") pod \"limitador-operator-controller-manager-859d7b78bd-xgxvl\" (UID: \"f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"
Jul 14 16:33:08.881846 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.881814    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmkgk\" (UniqueName: \"kubernetes.io/projected/f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f-kube-api-access-qmkgk\") pod \"limitador-operator-controller-manager-859d7b78bd-xgxvl\" (UID: \"f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"
Jul 14 16:33:08.953203 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.953152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:08.993906 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:08.993870    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"
Jul 14 16:33:11.583744 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:11.583694    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:11.739063 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:11.739021    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:16.472568 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:16.472525    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:16.573550 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:16.573508    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:16.847730 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:16.847689    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:17.785495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:17.785452    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:20.829988 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:20.829946    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:20.929674 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:20.929625    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:23.159713 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.159684    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:23.162459 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.162416    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:23.178274 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.178249    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:33:23.180319 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.180287    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:23.182237 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.182208    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vvzs5\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:33:23.292577 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.292533    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc216f2-2b2b-4824-95b4-0042acd1871a-extensions-socket-volume\") pod \"6cc216f2-2b2b-4824-95b4-0042acd1871a\" (UID: \"6cc216f2-2b2b-4824-95b4-0042acd1871a\") "
Jul 14 16:33:23.292770 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.292607    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h75t2\" (UniqueName: \"kubernetes.io/projected/4f508db6-3dfe-4f60-a15e-9b51e8f72d1e-kube-api-access-h75t2\") pod \"4f508db6-3dfe-4f60-a15e-9b51e8f72d1e\" (UID: \"4f508db6-3dfe-4f60-a15e-9b51e8f72d1e\") "
Jul 14 16:33:23.292770 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.292668    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl2zv\" (UniqueName: \"kubernetes.io/projected/6cc216f2-2b2b-4824-95b4-0042acd1871a-kube-api-access-gl2zv\") pod \"6cc216f2-2b2b-4824-95b4-0042acd1871a\" (UID: \"6cc216f2-2b2b-4824-95b4-0042acd1871a\") "
Jul 14 16:33:23.293007 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.292981    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cc216f2-2b2b-4824-95b4-0042acd1871a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6cc216f2-2b2b-4824-95b4-0042acd1871a" (UID: "6cc216f2-2b2b-4824-95b4-0042acd1871a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:33:23.294881 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.294848    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cc216f2-2b2b-4824-95b4-0042acd1871a-kube-api-access-gl2zv" (OuterVolumeSpecName: "kube-api-access-gl2zv") pod "6cc216f2-2b2b-4824-95b4-0042acd1871a" (UID: "6cc216f2-2b2b-4824-95b4-0042acd1871a"). InnerVolumeSpecName "kube-api-access-gl2zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:33:23.294985 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.294948    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f508db6-3dfe-4f60-a15e-9b51e8f72d1e-kube-api-access-h75t2" (OuterVolumeSpecName: "kube-api-access-h75t2") pod "4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" (UID: "4f508db6-3dfe-4f60-a15e-9b51e8f72d1e"). InnerVolumeSpecName "kube-api-access-h75t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:33:23.389697 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.389664    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"]
Jul 14 16:33:23.392744 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:33:23.392704    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18d3a7e_9405_4c6b_93fd_6b3a70fd7b0f.slice/crio-cbd4887193397d0728b0cf5187b0b59269949ce89cbc44b5f8d0a43744748200 WatchSource:0}: Error finding container cbd4887193397d0728b0cf5187b0b59269949ce89cbc44b5f8d0a43744748200: Status 404 returned error can't find the container with id cbd4887193397d0728b0cf5187b0b59269949ce89cbc44b5f8d0a43744748200
Jul 14 16:33:23.393860 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.393831    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h75t2\" (UniqueName: \"kubernetes.io/projected/4f508db6-3dfe-4f60-a15e-9b51e8f72d1e-kube-api-access-h75t2\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:33:23.393860 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.393852    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl2zv\" (UniqueName: \"kubernetes.io/projected/6cc216f2-2b2b-4824-95b4-0042acd1871a-kube-api-access-gl2zv\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:33:23.394012 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.393868    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc216f2-2b2b-4824-95b4-0042acd1871a-extensions-socket-volume\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:33:23.406134 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.406103    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"]
Jul 14 16:33:23.410373 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:33:23.410348    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5a197f_e11a_4610_9915_fe217b2b344b.slice/crio-667ad3203865013f595576f99eefa215a4f76af88560b0e8ba54ce7738b67946 WatchSource:0}: Error finding container 667ad3203865013f595576f99eefa215a4f76af88560b0e8ba54ce7738b67946: Status 404 returned error can't find the container with id 667ad3203865013f595576f99eefa215a4f76af88560b0e8ba54ce7738b67946
Jul 14 16:33:23.519381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.519339    2574 generic.go:356] "Generic (PLEG): container finished" podID="6cc216f2-2b2b-4824-95b4-0042acd1871a" containerID="5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128" exitCode=0
Jul 14 16:33:23.519571 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.519391    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:23.519571 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.519442    2574 scope.go:117] "RemoveContainer" containerID="5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128"
Jul 14 16:33:23.521264 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.521233    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl" event={"ID":"f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f","Type":"ContainerStarted","Data":"ce31ba38ec2573084fc20960e7481dbeb345a53657f0a4eb238e07f28bdeabec"}
Jul 14 16:33:23.521397 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.521288    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl" event={"ID":"f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f","Type":"ContainerStarted","Data":"cbd4887193397d0728b0cf5187b0b59269949ce89cbc44b5f8d0a43744748200"}
Jul 14 16:33:23.521397 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.521311    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"
Jul 14 16:33:23.522024 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.521994    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vvzs5\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:33:23.522761 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.522730    2574 generic.go:356] "Generic (PLEG): container finished" podID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" containerID="34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a" exitCode=0
Jul 14 16:33:23.522900 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.522770    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:33:23.524477 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.524448    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:23.524599 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.524530    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4" event={"ID":"b0fdf47b-8b1d-4753-8c54-d9c425567467","Type":"ContainerStarted","Data":"1b85d4aba5afd3e8ce385c166981c3994c3b791b0fa17315716a9df3ccd12adc"}
Jul 14 16:33:23.526399 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.526378    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg" event={"ID":"4e5a197f-e11a-4610-9915-fe217b2b344b","Type":"ContainerStarted","Data":"3ec10dca5e777f47ef0196a13252128f7418d35529e759d6e66cb02ea01d880e"}
Jul 14 16:33:23.526500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.526423    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg" event={"ID":"4e5a197f-e11a-4610-9915-fe217b2b344b","Type":"ContainerStarted","Data":"667ad3203865013f595576f99eefa215a4f76af88560b0e8ba54ce7738b67946"}
Jul 14 16:33:23.526500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.526455    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:23.526500 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.526480    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vvzs5\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:33:23.529813 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.529794    2574 scope.go:117] "RemoveContainer" containerID="5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128"
Jul 14 16:33:23.530129 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.530108    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128\": container with ID starting with 5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128 not found: ID does not exist" containerID="5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128"
Jul 14 16:33:23.530194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.530139    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128"} err="failed to get container status \"5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128\": rpc error: code = NotFound desc = could not find container \"5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128\": container with ID starting with 5429004757ad96ee9a7c7b20f765b96f551745b1d96cc102f30e7ddcd9867128 not found: ID does not exist"
Jul 14 16:33:23.530194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.530155    2574 scope.go:117] "RemoveContainer" containerID="34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a"
Jul 14 16:33:23.538224 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.538206    2574 scope.go:117] "RemoveContainer" containerID="34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a"
Jul 14 16:33:23.538503 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.538486    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a\": container with ID starting with 34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a not found: ID does not exist" containerID="34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a"
Jul 14 16:33:23.538563 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.538517    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a"} err="failed to get container status \"34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a\": rpc error: code = NotFound desc = could not find container \"34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a\": container with ID starting with 34d905b919bd195b846b8495e098d7d69759542bd8df0348c1309f1ea5f77d7a not found: ID does not exist"
Jul 14 16:33:23.558090 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.557998    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:23.587418 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.587357    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg" podStartSLOduration=15.587337845 podStartE2EDuration="15.587337845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:33:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:33:23.587105647 +0000 UTC m=+437.366269584" watchObservedRunningTime="2026-07-14 16:33:23.587337845 +0000 UTC m=+437.366501781"
Jul 14 16:33:23.589235 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.589184    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl" podStartSLOduration=15.589165073 podStartE2EDuration="15.589165073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:33:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:33:23.555300359 +0000 UTC m=+437.334464293" watchObservedRunningTime="2026-07-14 16:33:23.589165073 +0000 UTC m=+437.368329011"
Jul 14 16:33:23.589410 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.589320    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vvzs5\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvzs5"
Jul 14 16:33:23.592885 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:23.592852    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dmh8w\" is forbidden: User \"system:node:ip-10-0-130-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-193.ec2.internal' and this object" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmh8w"
Jul 14 16:33:23.617250 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:23.617191    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmrc4" podStartSLOduration=1.744643315 podStartE2EDuration="26.617155543s" totalImagesPullingTime="24.872512228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:33:23.614300566 +0000 UTC m=+437.393464503" watchObservedRunningTime="2026-07-14 16:33:23.617155543 +0000 UTC m=+437.396319478"
Jul 14 16:33:24.755753 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:24.755715    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f508db6-3dfe-4f60-a15e-9b51e8f72d1e" path="/var/lib/kubelet/pods/4f508db6-3dfe-4f60-a15e-9b51e8f72d1e/volumes"
Jul 14 16:33:24.756147 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:24.756101    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cc216f2-2b2b-4824-95b4-0042acd1871a" path="/var/lib/kubelet/pods/6cc216f2-2b2b-4824-95b4-0042acd1871a/volumes"
Jul 14 16:33:27.313932 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.313848    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"]
Jul 14 16:33:27.314324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.314046    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg" podUID="4e5a197f-e11a-4610-9915-fe217b2b344b" containerName="manager" containerID="cri-o://3ec10dca5e777f47ef0196a13252128f7418d35529e759d6e66cb02ea01d880e" gracePeriod=10
Jul 14 16:33:27.553022 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.552988    2574 generic.go:356] "Generic (PLEG): container finished" podID="4e5a197f-e11a-4610-9915-fe217b2b344b" containerID="3ec10dca5e777f47ef0196a13252128f7418d35529e759d6e66cb02ea01d880e" exitCode=0
Jul 14 16:33:27.553198 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.553055    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg" event={"ID":"4e5a197f-e11a-4610-9915-fe217b2b344b","Type":"ContainerDied","Data":"3ec10dca5e777f47ef0196a13252128f7418d35529e759d6e66cb02ea01d880e"}
Jul 14 16:33:27.581731 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.581650    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:27.728152 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.728116    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr7lp\" (UniqueName: \"kubernetes.io/projected/4e5a197f-e11a-4610-9915-fe217b2b344b-kube-api-access-kr7lp\") pod \"4e5a197f-e11a-4610-9915-fe217b2b344b\" (UID: \"4e5a197f-e11a-4610-9915-fe217b2b344b\") "
Jul 14 16:33:27.728359 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.728178    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5a197f-e11a-4610-9915-fe217b2b344b-extensions-socket-volume\") pod \"4e5a197f-e11a-4610-9915-fe217b2b344b\" (UID: \"4e5a197f-e11a-4610-9915-fe217b2b344b\") "
Jul 14 16:33:27.728575 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.728552    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5a197f-e11a-4610-9915-fe217b2b344b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4e5a197f-e11a-4610-9915-fe217b2b344b" (UID: "4e5a197f-e11a-4610-9915-fe217b2b344b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:33:27.730525 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.730497    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5a197f-e11a-4610-9915-fe217b2b344b-kube-api-access-kr7lp" (OuterVolumeSpecName: "kube-api-access-kr7lp") pod "4e5a197f-e11a-4610-9915-fe217b2b344b" (UID: "4e5a197f-e11a-4610-9915-fe217b2b344b"). InnerVolumeSpecName "kube-api-access-kr7lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:33:27.829700 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.829660    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr7lp\" (UniqueName: \"kubernetes.io/projected/4e5a197f-e11a-4610-9915-fe217b2b344b-kube-api-access-kr7lp\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:33:27.829700 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.829695    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5a197f-e11a-4610-9915-fe217b2b344b-extensions-socket-volume\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:33:27.876500 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.876410    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:27.987287 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:27.987245    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:28.559121 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:28.559089    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg" event={"ID":"4e5a197f-e11a-4610-9915-fe217b2b344b","Type":"ContainerDied","Data":"667ad3203865013f595576f99eefa215a4f76af88560b0e8ba54ce7738b67946"}
Jul 14 16:33:28.559121 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:28.559107    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"
Jul 14 16:33:28.559602 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:28.559145    2574 scope.go:117] "RemoveContainer" containerID="3ec10dca5e777f47ef0196a13252128f7418d35529e759d6e66cb02ea01d880e"
Jul 14 16:33:28.592072 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:28.592039    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"]
Jul 14 16:33:28.598997 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:28.598951    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgxbg"]
Jul 14 16:33:28.757742 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:28.757695    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e5a197f-e11a-4610-9915-fe217b2b344b" path="/var/lib/kubelet/pods/4e5a197f-e11a-4610-9915-fe217b2b344b/volumes"
Jul 14 16:33:34.540853 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:34.540821    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xgxvl"
Jul 14 16:33:43.798970 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:43.798931    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"]
Jul 14 16:33:43.799603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:43.799288    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e5a197f-e11a-4610-9915-fe217b2b344b" containerName="manager"
Jul 14 16:33:43.799603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:43.799301    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e5a197f-e11a-4610-9915-fe217b2b344b" containerName="manager"
Jul 14 16:33:43.799603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:43.799364    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e5a197f-e11a-4610-9915-fe217b2b344b" containerName="manager"
Jul 14 16:33:43.835072 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:43.835036    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:43.989198 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:43.989158    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"]
Jul 14 16:33:43.989366 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:43.989286    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:43.994185 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:43.994165    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jc8x6\""
Jul 14 16:33:44.070719 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.070610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.070719 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.070663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.070719 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.070691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.071031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.070735    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.071031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.070824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.071031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.070869    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.071031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.070890    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.071031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.070911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.071031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.070931    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7grf\" (UniqueName: \"kubernetes.io/projected/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-kube-api-access-j7grf\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.171999    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172294 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172294 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172294 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172294 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172165    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172475 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172475 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172475 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7grf\" (UniqueName: \"kubernetes.io/projected/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-kube-api-access-j7grf\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172475 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172669 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172498    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172848 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172821    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.172945 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.172894    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.173142 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.173122    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.174709 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.174691    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.174925 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.174904    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.184192 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.184159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.184612 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.184590    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7grf\" (UniqueName: \"kubernetes.io/projected/b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4-kube-api-access-j7grf\") pod \"maas-default-gateway-openshift-default-56654dcf7-jvbxl\" (UID: \"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.300901 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.300863    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:44.486550 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.486518    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"]
Jul 14 16:33:44.487571 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:33:44.487539    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cfa0a1_358a_45ad_bd92_c72b13bcbaf4.slice/crio-be3b1aed1f655cf8641500381a02fad763149344e5eb9e2377232577513c1be7 WatchSource:0}: Error finding container be3b1aed1f655cf8641500381a02fad763149344e5eb9e2377232577513c1be7: Status 404 returned error can't find the container with id be3b1aed1f655cf8641500381a02fad763149344e5eb9e2377232577513c1be7
Jul 14 16:33:44.489808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.489755    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:33:44.489917 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.489899    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:33:44.489957 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.489945    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:33:44.636587 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.636544    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" event={"ID":"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4","Type":"ContainerStarted","Data":"b072e1c172c3e96d51e7603534050756686d8d8d4a8b1c79fd09fc0b5aa42f9c"}
Jul 14 16:33:44.636752 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.636617    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" event={"ID":"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4","Type":"ContainerStarted","Data":"be3b1aed1f655cf8641500381a02fad763149344e5eb9e2377232577513c1be7"}
Jul 14 16:33:44.659494 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:44.659454    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:45.672474 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:45.672394    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" podStartSLOduration=2.67237034 podStartE2EDuration="2.67237034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:33:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:33:45.67083516 +0000 UTC m=+459.449999092" watchObservedRunningTime="2026-07-14 16:33:45.67237034 +0000 UTC m=+459.451534275"
Jul 14 16:33:46.301953 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.301920    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:46.307149 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.307117    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:46.645990 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.645902    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:46.646913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.646891    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:33:46.925572 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.925415    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dctcs"]
Jul 14 16:33:46.952921 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.952873    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:46.984284 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.984236    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dctcs"]
Jul 14 16:33:46.984450 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.984369    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:33:46.990251 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.990224    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 16:33:46.993833 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.993801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df340272-374d-41da-ad9f-2ebfd4d62f12-config-file\") pod \"limitador-limitador-64c94fd64f-dctcs\" (UID: \"df340272-374d-41da-ad9f-2ebfd4d62f12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:33:46.993972 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.993917    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbm57\" (UniqueName: \"kubernetes.io/projected/df340272-374d-41da-ad9f-2ebfd4d62f12-kube-api-access-kbm57\") pod \"limitador-limitador-64c94fd64f-dctcs\" (UID: \"df340272-374d-41da-ad9f-2ebfd4d62f12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:33:46.994281 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:46.994261    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dctcs"]
Jul 14 16:33:47.095425 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:47.095367    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df340272-374d-41da-ad9f-2ebfd4d62f12-config-file\") pod \"limitador-limitador-64c94fd64f-dctcs\" (UID: \"df340272-374d-41da-ad9f-2ebfd4d62f12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:33:47.095637 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:47.095493    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbm57\" (UniqueName: \"kubernetes.io/projected/df340272-374d-41da-ad9f-2ebfd4d62f12-kube-api-access-kbm57\") pod \"limitador-limitador-64c94fd64f-dctcs\" (UID: \"df340272-374d-41da-ad9f-2ebfd4d62f12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:33:47.096751 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:47.096720    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df340272-374d-41da-ad9f-2ebfd4d62f12-config-file\") pod \"limitador-limitador-64c94fd64f-dctcs\" (UID: \"df340272-374d-41da-ad9f-2ebfd4d62f12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:33:47.122373 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:47.122335    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbm57\" (UniqueName: \"kubernetes.io/projected/df340272-374d-41da-ad9f-2ebfd4d62f12-kube-api-access-kbm57\") pod \"limitador-limitador-64c94fd64f-dctcs\" (UID: \"df340272-374d-41da-ad9f-2ebfd4d62f12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:33:47.267998 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:47.267955    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:47.296952 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:47.296907    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:33:47.467306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:47.467273    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dctcs"]
Jul 14 16:33:47.472097 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:33:47.472067    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf340272_374d_41da_ad9f_2ebfd4d62f12.slice/crio-1ee2b5a92ecb3559b39425a7f2ba903fb1ea5db128b820a6eed195c06e110d25 WatchSource:0}: Error finding container 1ee2b5a92ecb3559b39425a7f2ba903fb1ea5db128b820a6eed195c06e110d25: Status 404 returned error can't find the container with id 1ee2b5a92ecb3559b39425a7f2ba903fb1ea5db128b820a6eed195c06e110d25
Jul 14 16:33:47.514878 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:47.514844    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:47.651864 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:47.651755    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs" event={"ID":"df340272-374d-41da-ad9f-2ebfd4d62f12","Type":"ContainerStarted","Data":"1ee2b5a92ecb3559b39425a7f2ba903fb1ea5db128b820a6eed195c06e110d25"}
Jul 14 16:33:48.364560 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.364518    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fxnjs"]
Jul 14 16:33:48.368396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.368372    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fxnjs"
Jul 14 16:33:48.392761 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.392717    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h5rkx\""
Jul 14 16:33:48.409305 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.409269    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwmm8\" (UniqueName: \"kubernetes.io/projected/89e2ed41-6c4b-4ad3-992a-9a8ee95e5192-kube-api-access-gwmm8\") pod \"authorino-58cd955675-fxnjs\" (UID: \"89e2ed41-6c4b-4ad3-992a-9a8ee95e5192\") " pod="kuadrant-system/authorino-58cd955675-fxnjs"
Jul 14 16:33:48.446344 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.446308    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:48.507033 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.506994    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fxnjs"]
Jul 14 16:33:48.510168 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.510134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwmm8\" (UniqueName: \"kubernetes.io/projected/89e2ed41-6c4b-4ad3-992a-9a8ee95e5192-kube-api-access-gwmm8\") pod \"authorino-58cd955675-fxnjs\" (UID: \"89e2ed41-6c4b-4ad3-992a-9a8ee95e5192\") " pod="kuadrant-system/authorino-58cd955675-fxnjs"
Jul 14 16:33:48.523019 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.522983    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwmm8\" (UniqueName: \"kubernetes.io/projected/89e2ed41-6c4b-4ad3-992a-9a8ee95e5192-kube-api-access-gwmm8\") pod \"authorino-58cd955675-fxnjs\" (UID: \"89e2ed41-6c4b-4ad3-992a-9a8ee95e5192\") " pod="kuadrant-system/authorino-58cd955675-fxnjs"
Jul 14 16:33:48.605466 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.605434    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:48.682822 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.682725    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fxnjs"
Jul 14 16:33:48.862987 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.862946    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fxnjs"]
Jul 14 16:33:48.899378 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.899347    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xt2k4"]
Jul 14 16:33:48.904983 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.904951    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xt2k4"
Jul 14 16:33:48.914661 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.914628    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqh58\" (UniqueName: \"kubernetes.io/projected/8a90e2c5-9853-4b77-a2dc-5914c743407e-kube-api-access-pqh58\") pod \"authorino-75d556bd77-xt2k4\" (UID: \"8a90e2c5-9853-4b77-a2dc-5914c743407e\") " pod="kuadrant-system/authorino-75d556bd77-xt2k4"
Jul 14 16:33:48.927997 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:48.927965    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xt2k4"]
Jul 14 16:33:49.016056 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:49.016010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqh58\" (UniqueName: \"kubernetes.io/projected/8a90e2c5-9853-4b77-a2dc-5914c743407e-kube-api-access-pqh58\") pod \"authorino-75d556bd77-xt2k4\" (UID: \"8a90e2c5-9853-4b77-a2dc-5914c743407e\") " pod="kuadrant-system/authorino-75d556bd77-xt2k4"
Jul 14 16:33:49.038828 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:49.038769    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqh58\" (UniqueName: \"kubernetes.io/projected/8a90e2c5-9853-4b77-a2dc-5914c743407e-kube-api-access-pqh58\") pod \"authorino-75d556bd77-xt2k4\" (UID: \"8a90e2c5-9853-4b77-a2dc-5914c743407e\") " pod="kuadrant-system/authorino-75d556bd77-xt2k4"
Jul 14 16:33:49.217394 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:49.217357    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xt2k4"
Jul 14 16:33:49.629891 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:33:49.629859    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89e2ed41_6c4b_4ad3_992a_9a8ee95e5192.slice/crio-6cc36ece3ae5653ac6fa9f968a6839730cfeae0a3c0796956e1ef8919520e794 WatchSource:0}: Error finding container 6cc36ece3ae5653ac6fa9f968a6839730cfeae0a3c0796956e1ef8919520e794: Status 404 returned error can't find the container with id 6cc36ece3ae5653ac6fa9f968a6839730cfeae0a3c0796956e1ef8919520e794
Jul 14 16:33:49.666635 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:49.666598    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fxnjs" event={"ID":"89e2ed41-6c4b-4ad3-992a-9a8ee95e5192","Type":"ContainerStarted","Data":"6cc36ece3ae5653ac6fa9f968a6839730cfeae0a3c0796956e1ef8919520e794"}
Jul 14 16:33:50.328449 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:50.328395    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xt2k4"]
Jul 14 16:33:50.329727 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:33:50.329705    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a90e2c5_9853_4b77_a2dc_5914c743407e.slice/crio-12c6f979aa85d9c2be588031fc6c953c453d5e562ea7b1d4d8c5d24e7bde271d WatchSource:0}: Error finding container 12c6f979aa85d9c2be588031fc6c953c453d5e562ea7b1d4d8c5d24e7bde271d: Status 404 returned error can't find the container with id 12c6f979aa85d9c2be588031fc6c953c453d5e562ea7b1d4d8c5d24e7bde271d
Jul 14 16:33:50.335655 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:50.335630    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:50.507297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:50.507259    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:50.673490 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:50.673453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs" event={"ID":"df340272-374d-41da-ad9f-2ebfd4d62f12","Type":"ContainerStarted","Data":"53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40"}
Jul 14 16:33:50.673992 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:50.673669    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:33:50.674822 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:50.674800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xt2k4" event={"ID":"8a90e2c5-9853-4b77-a2dc-5914c743407e","Type":"ContainerStarted","Data":"12c6f979aa85d9c2be588031fc6c953c453d5e562ea7b1d4d8c5d24e7bde271d"}
Jul 14 16:33:50.708108 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:50.708054    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs" podStartSLOduration=1.9469163969999999 podStartE2EDuration="4.708038699s" totalImagesPullingTime="2.761122302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:33:50.707967028 +0000 UTC m=+464.487130966" watchObservedRunningTime="2026-07-14 16:33:50.708038699 +0000 UTC m=+464.487202634"
Jul 14 16:33:54.698878 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:54.698831    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fxnjs" event={"ID":"89e2ed41-6c4b-4ad3-992a-9a8ee95e5192","Type":"ContainerStarted","Data":"1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54"}
Jul 14 16:33:54.700534 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:54.700487    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xt2k4" event={"ID":"8a90e2c5-9853-4b77-a2dc-5914c743407e","Type":"ContainerStarted","Data":"e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129"}
Jul 14 16:33:54.756186 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:54.756128    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fxnjs" podStartSLOduration=2.125183036 podStartE2EDuration="6.756108663s" totalImagesPullingTime="4.630925627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:33:54.721165063 +0000 UTC m=+468.500329003" watchObservedRunningTime="2026-07-14 16:33:54.756108663 +0000 UTC m=+468.535272600"
Jul 14 16:33:54.757019 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:54.756978    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xt2k4" podStartSLOduration=2.837563135 podStartE2EDuration="6.756966217s" totalImagesPullingTime="3.919403082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:33:54.755264197 +0000 UTC m=+468.534428144" watchObservedRunningTime="2026-07-14 16:33:54.756966217 +0000 UTC m=+468.536130154"
Jul 14 16:33:54.824234 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:54.824198    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fxnjs"]
Jul 14 16:33:56.709454 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:56.709417    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fxnjs" podUID="89e2ed41-6c4b-4ad3-992a-9a8ee95e5192" containerName="authorino" containerID="cri-o://1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54" gracePeriod=30
Jul 14 16:33:56.971480 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:56.971406    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fxnjs"
Jul 14 16:33:57.088900 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.088851    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwmm8\" (UniqueName: \"kubernetes.io/projected/89e2ed41-6c4b-4ad3-992a-9a8ee95e5192-kube-api-access-gwmm8\") pod \"89e2ed41-6c4b-4ad3-992a-9a8ee95e5192\" (UID: \"89e2ed41-6c4b-4ad3-992a-9a8ee95e5192\") "
Jul 14 16:33:57.091199 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.091160    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e2ed41-6c4b-4ad3-992a-9a8ee95e5192-kube-api-access-gwmm8" (OuterVolumeSpecName: "kube-api-access-gwmm8") pod "89e2ed41-6c4b-4ad3-992a-9a8ee95e5192" (UID: "89e2ed41-6c4b-4ad3-992a-9a8ee95e5192"). InnerVolumeSpecName "kube-api-access-gwmm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:33:57.190312 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.190265    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwmm8\" (UniqueName: \"kubernetes.io/projected/89e2ed41-6c4b-4ad3-992a-9a8ee95e5192-kube-api-access-gwmm8\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:33:57.714866 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.714827    2574 generic.go:356] "Generic (PLEG): container finished" podID="89e2ed41-6c4b-4ad3-992a-9a8ee95e5192" containerID="1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54" exitCode=0
Jul 14 16:33:57.715279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.714887    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fxnjs"
Jul 14 16:33:57.715279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.714903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fxnjs" event={"ID":"89e2ed41-6c4b-4ad3-992a-9a8ee95e5192","Type":"ContainerDied","Data":"1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54"}
Jul 14 16:33:57.715279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.714935    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fxnjs" event={"ID":"89e2ed41-6c4b-4ad3-992a-9a8ee95e5192","Type":"ContainerDied","Data":"6cc36ece3ae5653ac6fa9f968a6839730cfeae0a3c0796956e1ef8919520e794"}
Jul 14 16:33:57.715279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.714951    2574 scope.go:117] "RemoveContainer" containerID="1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54"
Jul 14 16:33:57.723635 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.723613    2574 scope.go:117] "RemoveContainer" containerID="1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54"
Jul 14 16:33:57.723947 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:33:57.723926    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54\": container with ID starting with 1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54 not found: ID does not exist" containerID="1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54"
Jul 14 16:33:57.724002 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.723958    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54"} err="failed to get container status \"1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54\": rpc error: code = NotFound desc = could not find container \"1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54\": container with ID starting with 1f3dacc09937ece9b5bf884b056204a1deedadb13c45c89e42f6bbbf0364ad54 not found: ID does not exist"
Jul 14 16:33:57.746879 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.746839    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fxnjs"]
Jul 14 16:33:57.749214 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:57.749187    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fxnjs"]
Jul 14 16:33:58.755436 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:33:58.755400    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e2ed41-6c4b-4ad3-992a-9a8ee95e5192" path="/var/lib/kubelet/pods/89e2ed41-6c4b-4ad3-992a-9a8ee95e5192/volumes"
Jul 14 16:34:01.682863 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:01.682835    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:34:02.060273 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.060234    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dctcs"]
Jul 14 16:34:02.060459 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.060418    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs" podUID="df340272-374d-41da-ad9f-2ebfd4d62f12" containerName="limitador" containerID="cri-o://53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40" gracePeriod=30
Jul 14 16:34:02.619198 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.619127    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:34:02.739666 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.739636    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbm57\" (UniqueName: \"kubernetes.io/projected/df340272-374d-41da-ad9f-2ebfd4d62f12-kube-api-access-kbm57\") pod \"df340272-374d-41da-ad9f-2ebfd4d62f12\" (UID: \"df340272-374d-41da-ad9f-2ebfd4d62f12\") "
Jul 14 16:34:02.740148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.739714    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df340272-374d-41da-ad9f-2ebfd4d62f12-config-file\") pod \"df340272-374d-41da-ad9f-2ebfd4d62f12\" (UID: \"df340272-374d-41da-ad9f-2ebfd4d62f12\") "
Jul 14 16:34:02.740148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.739862    2574 generic.go:356] "Generic (PLEG): container finished" podID="df340272-374d-41da-ad9f-2ebfd4d62f12" containerID="53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40" exitCode=0
Jul 14 16:34:02.740148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.739947    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs"
Jul 14 16:34:02.740148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.739965    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs" event={"ID":"df340272-374d-41da-ad9f-2ebfd4d62f12","Type":"ContainerDied","Data":"53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40"}
Jul 14 16:34:02.740148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.740046    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dctcs" event={"ID":"df340272-374d-41da-ad9f-2ebfd4d62f12","Type":"ContainerDied","Data":"1ee2b5a92ecb3559b39425a7f2ba903fb1ea5db128b820a6eed195c06e110d25"}
Jul 14 16:34:02.740148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.740080    2574 scope.go:117] "RemoveContainer" containerID="53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40"
Jul 14 16:34:02.740148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.740085    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df340272-374d-41da-ad9f-2ebfd4d62f12-config-file" (OuterVolumeSpecName: "config-file") pod "df340272-374d-41da-ad9f-2ebfd4d62f12" (UID: "df340272-374d-41da-ad9f-2ebfd4d62f12"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:34:02.742185 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.742159    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df340272-374d-41da-ad9f-2ebfd4d62f12-kube-api-access-kbm57" (OuterVolumeSpecName: "kube-api-access-kbm57") pod "df340272-374d-41da-ad9f-2ebfd4d62f12" (UID: "df340272-374d-41da-ad9f-2ebfd4d62f12"). InnerVolumeSpecName "kube-api-access-kbm57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:34:02.753152 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.753131    2574 scope.go:117] "RemoveContainer" containerID="53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40"
Jul 14 16:34:02.753449 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:34:02.753428    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40\": container with ID starting with 53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40 not found: ID does not exist" containerID="53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40"
Jul 14 16:34:02.753518 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.753457    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40"} err="failed to get container status \"53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40\": rpc error: code = NotFound desc = could not find container \"53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40\": container with ID starting with 53d031ab40c5899eba1f857c9843af07bb89a6e790e8947e976363ec46582b40 not found: ID does not exist"
Jul 14 16:34:02.841251 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.841196    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df340272-374d-41da-ad9f-2ebfd4d62f12-config-file\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:34:02.841251 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:02.841246    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbm57\" (UniqueName: \"kubernetes.io/projected/df340272-374d-41da-ad9f-2ebfd4d62f12-kube-api-access-kbm57\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:34:03.064807 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:03.064743    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dctcs"]
Jul 14 16:34:03.066221 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:03.066198    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dctcs"]
Jul 14 16:34:04.755713 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:04.755680    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df340272-374d-41da-ad9f-2ebfd4d62f12" path="/var/lib/kubelet/pods/df340272-374d-41da-ad9f-2ebfd4d62f12/volumes"
Jul 14 16:34:08.515997 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.515960    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-wzdl8"]
Jul 14 16:34:08.516477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.516425    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e2ed41-6c4b-4ad3-992a-9a8ee95e5192" containerName="authorino"
Jul 14 16:34:08.516477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.516444    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e2ed41-6c4b-4ad3-992a-9a8ee95e5192" containerName="authorino"
Jul 14 16:34:08.516477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.516469    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df340272-374d-41da-ad9f-2ebfd4d62f12" containerName="limitador"
Jul 14 16:34:08.516477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.516478    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="df340272-374d-41da-ad9f-2ebfd4d62f12" containerName="limitador"
Jul 14 16:34:08.516671 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.516574    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="df340272-374d-41da-ad9f-2ebfd4d62f12" containerName="limitador"
Jul 14 16:34:08.516671 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.516586    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e2ed41-6c4b-4ad3-992a-9a8ee95e5192" containerName="authorino"
Jul 14 16:34:08.519280 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.519253    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:08.523283 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.523257    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 14 16:34:08.523445 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.523350    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-htkvs\""
Jul 14 16:34:08.532368 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.532339    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wzdl8"]
Jul 14 16:34:08.590146 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.590113    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf4th\" (UniqueName: \"kubernetes.io/projected/ca88c71f-9311-4d2a-9bb0-39091b9174a2-kube-api-access-lf4th\") pod \"postgres-69fb4594cf-wzdl8\" (UID: \"ca88c71f-9311-4d2a-9bb0-39091b9174a2\") " pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:08.590336 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.590239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca88c71f-9311-4d2a-9bb0-39091b9174a2-data\") pod \"postgres-69fb4594cf-wzdl8\" (UID: \"ca88c71f-9311-4d2a-9bb0-39091b9174a2\") " pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:08.591188 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.591161    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:08.691655 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.691608    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca88c71f-9311-4d2a-9bb0-39091b9174a2-data\") pod \"postgres-69fb4594cf-wzdl8\" (UID: \"ca88c71f-9311-4d2a-9bb0-39091b9174a2\") " pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:08.691655 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.691661    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf4th\" (UniqueName: \"kubernetes.io/projected/ca88c71f-9311-4d2a-9bb0-39091b9174a2-kube-api-access-lf4th\") pod \"postgres-69fb4594cf-wzdl8\" (UID: \"ca88c71f-9311-4d2a-9bb0-39091b9174a2\") " pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:08.692081 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.692061    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca88c71f-9311-4d2a-9bb0-39091b9174a2-data\") pod \"postgres-69fb4594cf-wzdl8\" (UID: \"ca88c71f-9311-4d2a-9bb0-39091b9174a2\") " pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:08.705943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.705913    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf4th\" (UniqueName: \"kubernetes.io/projected/ca88c71f-9311-4d2a-9bb0-39091b9174a2-kube-api-access-lf4th\") pod \"postgres-69fb4594cf-wzdl8\" (UID: \"ca88c71f-9311-4d2a-9bb0-39091b9174a2\") " pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:08.829098 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.829010    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:08.989853 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:08.989818    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wzdl8"]
Jul 14 16:34:08.993124 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:34:08.993088    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca88c71f_9311_4d2a_9bb0_39091b9174a2.slice/crio-2b85d7036ea4aa4aa6f2d19cef28f2f18246a026703a95594c0eab864604fee7 WatchSource:0}: Error finding container 2b85d7036ea4aa4aa6f2d19cef28f2f18246a026703a95594c0eab864604fee7: Status 404 returned error can't find the container with id 2b85d7036ea4aa4aa6f2d19cef28f2f18246a026703a95594c0eab864604fee7
Jul 14 16:34:09.771307 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:09.771275    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wzdl8" event={"ID":"ca88c71f-9311-4d2a-9bb0-39091b9174a2","Type":"ContainerStarted","Data":"2b85d7036ea4aa4aa6f2d19cef28f2f18246a026703a95594c0eab864604fee7"}
Jul 14 16:34:15.803265 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:15.803225    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wzdl8" event={"ID":"ca88c71f-9311-4d2a-9bb0-39091b9174a2","Type":"ContainerStarted","Data":"076750cd5dd8ad58a572c4b825de8f16f4f9d8d4d575d330fdec10f919d0e9f7"}
Jul 14 16:34:15.803763 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:15.803327    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:15.843456 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:15.843398    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-wzdl8" podStartSLOduration=2.057203408 podStartE2EDuration="7.843378172s" totalImagesPullingTime="5.786174764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:34:15.841906922 +0000 UTC m=+489.621070859" watchObservedRunningTime="2026-07-14 16:34:15.843378172 +0000 UTC m=+489.622542134"
Jul 14 16:34:21.838775 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:21.838732    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-wzdl8"
Jul 14 16:34:22.270624 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.270573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:22.444317 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.444274    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:22.510994 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.510950    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l7slt"]
Jul 14 16:34:22.519145 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.519117    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-l7slt"
Jul 14 16:34:22.525718 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.525653    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l7slt"]
Jul 14 16:34:22.617252 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.617210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br7wk\" (UniqueName: \"kubernetes.io/projected/740daae7-153e-49e2-bd6c-d2ab73c7de2d-kube-api-access-br7wk\") pod \"authorino-5d4b67c446-l7slt\" (UID: \"740daae7-153e-49e2-bd6c-d2ab73c7de2d\") " pod="kuadrant-system/authorino-5d4b67c446-l7slt"
Jul 14 16:34:22.717815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.717741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br7wk\" (UniqueName: \"kubernetes.io/projected/740daae7-153e-49e2-bd6c-d2ab73c7de2d-kube-api-access-br7wk\") pod \"authorino-5d4b67c446-l7slt\" (UID: \"740daae7-153e-49e2-bd6c-d2ab73c7de2d\") " pod="kuadrant-system/authorino-5d4b67c446-l7slt"
Jul 14 16:34:22.729013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.728982    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br7wk\" (UniqueName: \"kubernetes.io/projected/740daae7-153e-49e2-bd6c-d2ab73c7de2d-kube-api-access-br7wk\") pod \"authorino-5d4b67c446-l7slt\" (UID: \"740daae7-153e-49e2-bd6c-d2ab73c7de2d\") " pod="kuadrant-system/authorino-5d4b67c446-l7slt"
Jul 14 16:34:22.798368 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.798276    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l7slt"]
Jul 14 16:34:22.798569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.798556    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-l7slt"
Jul 14 16:34:22.841395 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.841187    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fcff4b989-7mllc"]
Jul 14 16:34:22.846054 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.846029    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcff4b989-7mllc"
Jul 14 16:34:22.857571 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.857538    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fcff4b989-7mllc"]
Jul 14 16:34:22.951393 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:22.951279    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l7slt"]
Jul 14 16:34:22.954188 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:34:22.954157    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod740daae7_153e_49e2_bd6c_d2ab73c7de2d.slice/crio-cc6e5b56c72ffe0ac1e0dd3aa26f4d8db6501dd3b9af1b20097d6868056867ca WatchSource:0}: Error finding container cc6e5b56c72ffe0ac1e0dd3aa26f4d8db6501dd3b9af1b20097d6868056867ca: Status 404 returned error can't find the container with id cc6e5b56c72ffe0ac1e0dd3aa26f4d8db6501dd3b9af1b20097d6868056867ca
Jul 14 16:34:23.008246 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.008208    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fcff4b989-7mllc"]
Jul 14 16:34:23.008568 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:34:23.008540    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-66fqg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-fcff4b989-7mllc" podUID="1790f08b-f273-43c9-b427-99cd2488d0f5"
Jul 14 16:34:23.020092 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.020048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66fqg\" (UniqueName: \"kubernetes.io/projected/1790f08b-f273-43c9-b427-99cd2488d0f5-kube-api-access-66fqg\") pod \"authorino-fcff4b989-7mllc\" (UID: \"1790f08b-f273-43c9-b427-99cd2488d0f5\") " pod="kuadrant-system/authorino-fcff4b989-7mllc"
Jul 14 16:34:23.061776 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.061693    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b6884fcfc-tmmxp"]
Jul 14 16:34:23.065448 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.065429    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:34:23.068202 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.068181    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 14 16:34:23.076104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.076077    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b6884fcfc-tmmxp"]
Jul 14 16:34:23.120743 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.120699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66fqg\" (UniqueName: \"kubernetes.io/projected/1790f08b-f273-43c9-b427-99cd2488d0f5-kube-api-access-66fqg\") pod \"authorino-fcff4b989-7mllc\" (UID: \"1790f08b-f273-43c9-b427-99cd2488d0f5\") " pod="kuadrant-system/authorino-fcff4b989-7mllc"
Jul 14 16:34:23.131200 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.131169    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66fqg\" (UniqueName: \"kubernetes.io/projected/1790f08b-f273-43c9-b427-99cd2488d0f5-kube-api-access-66fqg\") pod \"authorino-fcff4b989-7mllc\" (UID: \"1790f08b-f273-43c9-b427-99cd2488d0f5\") " pod="kuadrant-system/authorino-fcff4b989-7mllc"
Jul 14 16:34:23.221424 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.221382    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-tls-cert\") pod \"authorino-7b6884fcfc-tmmxp\" (UID: \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\") " pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:34:23.221574 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.221500    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjcr9\" (UniqueName: \"kubernetes.io/projected/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-kube-api-access-qjcr9\") pod \"authorino-7b6884fcfc-tmmxp\" (UID: \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\") " pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:34:23.322756 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.322660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-tls-cert\") pod \"authorino-7b6884fcfc-tmmxp\" (UID: \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\") " pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:34:23.322756 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.322748    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjcr9\" (UniqueName: \"kubernetes.io/projected/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-kube-api-access-qjcr9\") pod \"authorino-7b6884fcfc-tmmxp\" (UID: \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\") " pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:34:23.325296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.325266    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-tls-cert\") pod \"authorino-7b6884fcfc-tmmxp\" (UID: \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\") " pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:34:23.335453 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.335421    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjcr9\" (UniqueName: \"kubernetes.io/projected/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-kube-api-access-qjcr9\") pod \"authorino-7b6884fcfc-tmmxp\" (UID: \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\") " pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:34:23.375016 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.374993    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:34:23.550397 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.550372    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b6884fcfc-tmmxp"]
Jul 14 16:34:23.552811 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:34:23.552750    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f73e05e_739f_45fa_ae6d_2a5fe69b55e5.slice/crio-b0676b368344192f156c9d2cee9e93b14c4e9b785ed121261c0bb51123227fb1 WatchSource:0}: Error finding container b0676b368344192f156c9d2cee9e93b14c4e9b785ed121261c0bb51123227fb1: Status 404 returned error can't find the container with id b0676b368344192f156c9d2cee9e93b14c4e9b785ed121261c0bb51123227fb1
Jul 14 16:34:23.839958 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.839925    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp" event={"ID":"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5","Type":"ContainerStarted","Data":"b0676b368344192f156c9d2cee9e93b14c4e9b785ed121261c0bb51123227fb1"}
Jul 14 16:34:23.841385 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.841358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-l7slt" event={"ID":"740daae7-153e-49e2-bd6c-d2ab73c7de2d","Type":"ContainerStarted","Data":"d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007"}
Jul 14 16:34:23.841501 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.841396    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-l7slt" event={"ID":"740daae7-153e-49e2-bd6c-d2ab73c7de2d","Type":"ContainerStarted","Data":"cc6e5b56c72ffe0ac1e0dd3aa26f4d8db6501dd3b9af1b20097d6868056867ca"}
Jul 14 16:34:23.841501 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.841450    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcff4b989-7mllc"
Jul 14 16:34:23.841501 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.841453    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-l7slt" podUID="740daae7-153e-49e2-bd6c-d2ab73c7de2d" containerName="authorino" containerID="cri-o://d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007" gracePeriod=30
Jul 14 16:34:23.849388 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.849366    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcff4b989-7mllc"
Jul 14 16:34:23.863316 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:23.863262    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-l7slt" podStartSLOduration=1.447470282 podStartE2EDuration="1.863242851s" totalImagesPullingTime="415.772569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:34:23.861012012 +0000 UTC m=+497.640175947" watchObservedRunningTime="2026-07-14 16:34:23.863242851 +0000 UTC m=+497.642406786"
Jul 14 16:34:24.029091 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.029055    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66fqg\" (UniqueName: \"kubernetes.io/projected/1790f08b-f273-43c9-b427-99cd2488d0f5-kube-api-access-66fqg\") pod \"1790f08b-f273-43c9-b427-99cd2488d0f5\" (UID: \"1790f08b-f273-43c9-b427-99cd2488d0f5\") "
Jul 14 16:34:24.031424 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.031381    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1790f08b-f273-43c9-b427-99cd2488d0f5-kube-api-access-66fqg" (OuterVolumeSpecName: "kube-api-access-66fqg") pod "1790f08b-f273-43c9-b427-99cd2488d0f5" (UID: "1790f08b-f273-43c9-b427-99cd2488d0f5"). InnerVolumeSpecName "kube-api-access-66fqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:34:24.103294 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.103223    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-l7slt"
Jul 14 16:34:24.129855 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.129822    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66fqg\" (UniqueName: \"kubernetes.io/projected/1790f08b-f273-43c9-b427-99cd2488d0f5-kube-api-access-66fqg\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:34:24.231101 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.231058    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br7wk\" (UniqueName: \"kubernetes.io/projected/740daae7-153e-49e2-bd6c-d2ab73c7de2d-kube-api-access-br7wk\") pod \"740daae7-153e-49e2-bd6c-d2ab73c7de2d\" (UID: \"740daae7-153e-49e2-bd6c-d2ab73c7de2d\") "
Jul 14 16:34:24.233425 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.233388    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/740daae7-153e-49e2-bd6c-d2ab73c7de2d-kube-api-access-br7wk" (OuterVolumeSpecName: "kube-api-access-br7wk") pod "740daae7-153e-49e2-bd6c-d2ab73c7de2d" (UID: "740daae7-153e-49e2-bd6c-d2ab73c7de2d"). InnerVolumeSpecName "kube-api-access-br7wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:34:24.332173 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.332131    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br7wk\" (UniqueName: \"kubernetes.io/projected/740daae7-153e-49e2-bd6c-d2ab73c7de2d-kube-api-access-br7wk\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:34:24.848803 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.848746    2574 generic.go:356] "Generic (PLEG): container finished" podID="740daae7-153e-49e2-bd6c-d2ab73c7de2d" containerID="d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007" exitCode=0
Jul 14 16:34:24.848803 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.848805    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-l7slt"
Jul 14 16:34:24.849311 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.848830    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-l7slt" event={"ID":"740daae7-153e-49e2-bd6c-d2ab73c7de2d","Type":"ContainerDied","Data":"d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007"}
Jul 14 16:34:24.849311 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.848876    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-l7slt" event={"ID":"740daae7-153e-49e2-bd6c-d2ab73c7de2d","Type":"ContainerDied","Data":"cc6e5b56c72ffe0ac1e0dd3aa26f4d8db6501dd3b9af1b20097d6868056867ca"}
Jul 14 16:34:24.849311 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.848899    2574 scope.go:117] "RemoveContainer" containerID="d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007"
Jul 14 16:34:24.851094 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.851070    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcff4b989-7mllc"
Jul 14 16:34:24.851217 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.851149    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp" event={"ID":"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5","Type":"ContainerStarted","Data":"c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c"}
Jul 14 16:34:24.860185 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.860165    2574 scope.go:117] "RemoveContainer" containerID="d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007"
Jul 14 16:34:24.860581 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:34:24.860554    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007\": container with ID starting with d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007 not found: ID does not exist" containerID="d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007"
Jul 14 16:34:24.860683 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.860589    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007"} err="failed to get container status \"d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007\": rpc error: code = NotFound desc = could not find container \"d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007\": container with ID starting with d9c3c0d829b774676dfc1c520094472e9ee79f2f665c899b2b315aaff46da007 not found: ID does not exist"
Jul 14 16:34:24.872715 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.872673    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l7slt"]
Jul 14 16:34:24.880109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.880076    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l7slt"]
Jul 14 16:34:24.913415 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.913356    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp" podStartSLOduration=0.727839701 podStartE2EDuration="1.913340577s" totalImagesPullingTime="1.185500876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:34:24.912684456 +0000 UTC m=+498.691848396" watchObservedRunningTime="2026-07-14 16:34:24.913340577 +0000 UTC m=+498.692504561"
Jul 14 16:34:24.951221 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.951185    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xt2k4"]
Jul 14 16:34:24.951404 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.951381    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xt2k4" podUID="8a90e2c5-9853-4b77-a2dc-5914c743407e" containerName="authorino" containerID="cri-o://e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129" gracePeriod=30
Jul 14 16:34:24.960222 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.960192    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fcff4b989-7mllc"]
Jul 14 16:34:24.966682 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:24.966646    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fcff4b989-7mllc"]
Jul 14 16:34:25.203466 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.203428    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xt2k4"
Jul 14 16:34:25.342160 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.342064    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqh58\" (UniqueName: \"kubernetes.io/projected/8a90e2c5-9853-4b77-a2dc-5914c743407e-kube-api-access-pqh58\") pod \"8a90e2c5-9853-4b77-a2dc-5914c743407e\" (UID: \"8a90e2c5-9853-4b77-a2dc-5914c743407e\") "
Jul 14 16:34:25.344334 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.344304    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a90e2c5-9853-4b77-a2dc-5914c743407e-kube-api-access-pqh58" (OuterVolumeSpecName: "kube-api-access-pqh58") pod "8a90e2c5-9853-4b77-a2dc-5914c743407e" (UID: "8a90e2c5-9853-4b77-a2dc-5914c743407e"). InnerVolumeSpecName "kube-api-access-pqh58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:34:25.443494 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.443447    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqh58\" (UniqueName: \"kubernetes.io/projected/8a90e2c5-9853-4b77-a2dc-5914c743407e-kube-api-access-pqh58\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:34:25.856918 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.856877    2574 generic.go:356] "Generic (PLEG): container finished" podID="8a90e2c5-9853-4b77-a2dc-5914c743407e" containerID="e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129" exitCode=0
Jul 14 16:34:25.856918 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.856916    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xt2k4"
Jul 14 16:34:25.856918 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.856916    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xt2k4" event={"ID":"8a90e2c5-9853-4b77-a2dc-5914c743407e","Type":"ContainerDied","Data":"e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129"}
Jul 14 16:34:25.857482 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.856965    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xt2k4" event={"ID":"8a90e2c5-9853-4b77-a2dc-5914c743407e","Type":"ContainerDied","Data":"12c6f979aa85d9c2be588031fc6c953c453d5e562ea7b1d4d8c5d24e7bde271d"}
Jul 14 16:34:25.857482 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.856986    2574 scope.go:117] "RemoveContainer" containerID="e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129"
Jul 14 16:34:25.865728 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.865707    2574 scope.go:117] "RemoveContainer" containerID="e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129"
Jul 14 16:34:25.866026 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:34:25.866009    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129\": container with ID starting with e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129 not found: ID does not exist" containerID="e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129"
Jul 14 16:34:25.866070 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.866034    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129"} err="failed to get container status \"e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129\": rpc error: code = NotFound desc = could not find container \"e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129\": container with ID starting with e682164bea711552bc520b0df70c57181373cb879549c1ae645b3d2ab4383129 not found: ID does not exist"
Jul 14 16:34:25.904547 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.904512    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xt2k4"]
Jul 14 16:34:25.916978 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:25.916939    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xt2k4"]
Jul 14 16:34:26.757108 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:26.757075    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1790f08b-f273-43c9-b427-99cd2488d0f5" path="/var/lib/kubelet/pods/1790f08b-f273-43c9-b427-99cd2488d0f5/volumes"
Jul 14 16:34:26.757294 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:26.757281    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="740daae7-153e-49e2-bd6c-d2ab73c7de2d" path="/var/lib/kubelet/pods/740daae7-153e-49e2-bd6c-d2ab73c7de2d/volumes"
Jul 14 16:34:26.757569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:26.757554    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a90e2c5-9853-4b77-a2dc-5914c743407e" path="/var/lib/kubelet/pods/8a90e2c5-9853-4b77-a2dc-5914c743407e/volumes"
Jul 14 16:34:29.884176 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.884142    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b9957b86c-tvt6z"]
Jul 14 16:34:29.884583 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.884467    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="740daae7-153e-49e2-bd6c-d2ab73c7de2d" containerName="authorino"
Jul 14 16:34:29.884583 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.884477    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="740daae7-153e-49e2-bd6c-d2ab73c7de2d" containerName="authorino"
Jul 14 16:34:29.884583 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.884486    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a90e2c5-9853-4b77-a2dc-5914c743407e" containerName="authorino"
Jul 14 16:34:29.884583 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.884491    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a90e2c5-9853-4b77-a2dc-5914c743407e" containerName="authorino"
Jul 14 16:34:29.884583 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.884544    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a90e2c5-9853-4b77-a2dc-5914c743407e" containerName="authorino"
Jul 14 16:34:29.884583 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.884554    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="740daae7-153e-49e2-bd6c-d2ab73c7de2d" containerName="authorino"
Jul 14 16:34:29.887464 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.887443    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:29.887675 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.887645    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:29.895598 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.895571    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 16:34:29.895811 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.895682    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 16:34:29.896300 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.896026    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-42klz\""
Jul 14 16:34:29.979685 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.979647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd26z\" (UniqueName: \"kubernetes.io/projected/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-kube-api-access-zd26z\") pod \"maas-controller-5b9957b86c-tvt6z\" (UID: \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\") " pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:29.979906 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:29.979749    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-webhook-cert\") pod \"maas-controller-5b9957b86c-tvt6z\" (UID: \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\") " pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:30.041369 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.041330    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b9957b86c-tvt6z"]
Jul 14 16:34:30.051109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.051072    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:30.080176 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.080145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-webhook-cert\") pod \"maas-controller-5b9957b86c-tvt6z\" (UID: \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\") " pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:30.080344 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.080189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd26z\" (UniqueName: \"kubernetes.io/projected/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-kube-api-access-zd26z\") pod \"maas-controller-5b9957b86c-tvt6z\" (UID: \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\") " pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:30.080344 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:34:30.080311    2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 14 16:34:30.080428 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:34:30.080394    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-webhook-cert podName:4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3 nodeName:}" failed. No retries permitted until 2026-07-14 16:34:30.580372477 +0000 UTC m=+504.359536395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-webhook-cert") pod "maas-controller-5b9957b86c-tvt6z" (UID: "4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3") : secret "maas-controller-webhook-cert" not found
Jul 14 16:34:30.099756 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.099722    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd26z\" (UniqueName: \"kubernetes.io/projected/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-kube-api-access-zd26z\") pod \"maas-controller-5b9957b86c-tvt6z\" (UID: \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\") " pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:30.214045 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.213949    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:30.384489 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.384440    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:30.583571 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.583533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-webhook-cert\") pod \"maas-controller-5b9957b86c-tvt6z\" (UID: \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\") " pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:30.586142 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.586120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-webhook-cert\") pod \"maas-controller-5b9957b86c-tvt6z\" (UID: \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\") " pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:30.800164 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.800113    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:30.953560 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:30.953532    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b9957b86c-tvt6z"]
Jul 14 16:34:30.955881 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:34:30.955839    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb833c2_1320_4d58_8ce8_fdfdf4c03fd3.slice/crio-3484a530d72b5db919a06afe6c04a73be76006d5f527c165641808d066c2811a WatchSource:0}: Error finding container 3484a530d72b5db919a06afe6c04a73be76006d5f527c165641808d066c2811a: Status 404 returned error can't find the container with id 3484a530d72b5db919a06afe6c04a73be76006d5f527c165641808d066c2811a
Jul 14 16:34:31.889148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:31.889061    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9957b86c-tvt6z" event={"ID":"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3","Type":"ContainerStarted","Data":"3484a530d72b5db919a06afe6c04a73be76006d5f527c165641808d066c2811a"}
Jul 14 16:34:32.715674 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:32.715598    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:32.809742 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:32.809692    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:33.900581 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:33.900541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9957b86c-tvt6z" event={"ID":"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3","Type":"ContainerStarted","Data":"f54461792ff0644eecf364c4317bb571961d32bcc394833b0407df6161cafa73"}
Jul 14 16:34:33.900994 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:33.900607    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:33.918944 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:33.918885    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b9957b86c-tvt6z" podStartSLOduration=2.564737661 podStartE2EDuration="4.918866371s" totalImagesPullingTime="2.35412871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:34:33.917396805 +0000 UTC m=+507.696560741" watchObservedRunningTime="2026-07-14 16:34:33.918866371 +0000 UTC m=+507.698030363"
Jul 14 16:34:43.694018 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.693982    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b9957b86c-tvt6z"]
Jul 14 16:34:43.694453 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.694188    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b9957b86c-tvt6z" podUID="4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3" containerName="manager" containerID="cri-o://f54461792ff0644eecf364c4317bb571961d32bcc394833b0407df6161cafa73" gracePeriod=30
Jul 14 16:34:43.700843 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.700812    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:43.948522 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.948452    2574 generic.go:356] "Generic (PLEG): container finished" podID="4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3" containerID="f54461792ff0644eecf364c4317bb571961d32bcc394833b0407df6161cafa73" exitCode=0
Jul 14 16:34:43.948660 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.948536    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9957b86c-tvt6z" event={"ID":"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3","Type":"ContainerDied","Data":"f54461792ff0644eecf364c4317bb571961d32bcc394833b0407df6161cafa73"}
Jul 14 16:34:43.948660 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.948598    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9957b86c-tvt6z" event={"ID":"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3","Type":"ContainerDied","Data":"3484a530d72b5db919a06afe6c04a73be76006d5f527c165641808d066c2811a"}
Jul 14 16:34:43.948660 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.948622    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3484a530d72b5db919a06afe6c04a73be76006d5f527c165641808d066c2811a"
Jul 14 16:34:43.958581 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.958552    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:43.999758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.999723    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd26z\" (UniqueName: \"kubernetes.io/projected/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-kube-api-access-zd26z\") pod \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\" (UID: \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\") "
Jul 14 16:34:43.999948 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:43.999924    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-webhook-cert\") pod \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\" (UID: \"4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3\") "
Jul 14 16:34:44.002107 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:44.002067    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3" (UID: "4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:34:44.002237 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:44.002108    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-kube-api-access-zd26z" (OuterVolumeSpecName: "kube-api-access-zd26z") pod "4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3" (UID: "4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3"). InnerVolumeSpecName "kube-api-access-zd26z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:34:44.101440 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:44.101400    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-webhook-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:34:44.101440 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:44.101432    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd26z\" (UniqueName: \"kubernetes.io/projected/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3-kube-api-access-zd26z\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:34:44.952910 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:44.952879    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9957b86c-tvt6z"
Jul 14 16:34:44.975716 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:44.975676    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b9957b86c-tvt6z"]
Jul 14 16:34:44.978871 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:44.978832    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b9957b86c-tvt6z"]
Jul 14 16:34:46.755596 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:46.755560    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3" path="/var/lib/kubelet/pods/4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3/volumes"
Jul 14 16:34:53.639794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:34:53.639746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:03.687800 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:03.687724    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:04.128185 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.128144    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:04.824689 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.824655    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:04.930270 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.930233    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6b45cfb7cb-q2z86"]
Jul 14 16:35:04.930583 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.930570    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3" containerName="manager"
Jul 14 16:35:04.930628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.930585    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3" containerName="manager"
Jul 14 16:35:04.930668 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.930641    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cb833c2-1320-4d58-8ce8-fdfdf4c03fd3" containerName="manager"
Jul 14 16:35:04.933641 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.933620    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:04.936654 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.936631    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lsszz\""
Jul 14 16:35:04.937536 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.937515    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 14 16:35:04.963015 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:04.962971    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b45cfb7cb-q2z86"]
Jul 14 16:35:05.079622 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.079534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a61db4a-80b3-4f4d-aa1c-51e4019bf939-maas-api-tls\") pod \"maas-api-6b45cfb7cb-q2z86\" (UID: \"8a61db4a-80b3-4f4d-aa1c-51e4019bf939\") " pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.079761 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.079649    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a61db4a-80b3-4f4d-aa1c-51e4019bf939-openshift-service-ca\") pod \"maas-api-6b45cfb7cb-q2z86\" (UID: \"8a61db4a-80b3-4f4d-aa1c-51e4019bf939\") " pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.079761 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.079683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86c7r\" (UniqueName: \"kubernetes.io/projected/8a61db4a-80b3-4f4d-aa1c-51e4019bf939-kube-api-access-86c7r\") pod \"maas-api-6b45cfb7cb-q2z86\" (UID: \"8a61db4a-80b3-4f4d-aa1c-51e4019bf939\") " pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.083238 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.083208    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:05.180953 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.180910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a61db4a-80b3-4f4d-aa1c-51e4019bf939-openshift-service-ca\") pod \"maas-api-6b45cfb7cb-q2z86\" (UID: \"8a61db4a-80b3-4f4d-aa1c-51e4019bf939\") " pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.181159 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.180971    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86c7r\" (UniqueName: \"kubernetes.io/projected/8a61db4a-80b3-4f4d-aa1c-51e4019bf939-kube-api-access-86c7r\") pod \"maas-api-6b45cfb7cb-q2z86\" (UID: \"8a61db4a-80b3-4f4d-aa1c-51e4019bf939\") " pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.181159 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.181006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a61db4a-80b3-4f4d-aa1c-51e4019bf939-maas-api-tls\") pod \"maas-api-6b45cfb7cb-q2z86\" (UID: \"8a61db4a-80b3-4f4d-aa1c-51e4019bf939\") " pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.181581 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.181559    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a61db4a-80b3-4f4d-aa1c-51e4019bf939-openshift-service-ca\") pod \"maas-api-6b45cfb7cb-q2z86\" (UID: \"8a61db4a-80b3-4f4d-aa1c-51e4019bf939\") " pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.183648 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.183617    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a61db4a-80b3-4f4d-aa1c-51e4019bf939-maas-api-tls\") pod \"maas-api-6b45cfb7cb-q2z86\" (UID: \"8a61db4a-80b3-4f4d-aa1c-51e4019bf939\") " pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.192179 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.192154    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86c7r\" (UniqueName: \"kubernetes.io/projected/8a61db4a-80b3-4f4d-aa1c-51e4019bf939-kube-api-access-86c7r\") pod \"maas-api-6b45cfb7cb-q2z86\" (UID: \"8a61db4a-80b3-4f4d-aa1c-51e4019bf939\") " pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.244679 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.244644    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:05.406883 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.406857    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b45cfb7cb-q2z86"]
Jul 14 16:35:05.409044 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:35:05.409015    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a61db4a_80b3_4f4d_aa1c_51e4019bf939.slice/crio-af45c7f36cc820a35e5c715dc51b83ae786fa4859607871fa99042cde32cae43 WatchSource:0}: Error finding container af45c7f36cc820a35e5c715dc51b83ae786fa4859607871fa99042cde32cae43: Status 404 returned error can't find the container with id af45c7f36cc820a35e5c715dc51b83ae786fa4859607871fa99042cde32cae43
Jul 14 16:35:05.537308 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.537279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:05.627514 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.627415    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:05.680235 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.680196    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-w8whb"]
Jul 14 16:35:05.684756 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.684725    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:05.688254 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.688231    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-r27hz\""
Jul 14 16:35:05.688384 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.688264    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 14 16:35:05.698988 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.698957    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-w8whb"]
Jul 14 16:35:05.787088 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.787051    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7b857fe-eaf9-42d2-af7c-7cace5e581b3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-w8whb\" (UID: \"d7b857fe-eaf9-42d2-af7c-7cace5e581b3\") " pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:05.787288 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.787104    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jslz8\" (UniqueName: \"kubernetes.io/projected/d7b857fe-eaf9-42d2-af7c-7cace5e581b3-kube-api-access-jslz8\") pod \"payload-pre-processing-7964457696-w8whb\" (UID: \"d7b857fe-eaf9-42d2-af7c-7cace5e581b3\") " pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:05.888501 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.888373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7b857fe-eaf9-42d2-af7c-7cace5e581b3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-w8whb\" (UID: \"d7b857fe-eaf9-42d2-af7c-7cace5e581b3\") " pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:05.888501 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.888456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jslz8\" (UniqueName: \"kubernetes.io/projected/d7b857fe-eaf9-42d2-af7c-7cace5e581b3-kube-api-access-jslz8\") pod \"payload-pre-processing-7964457696-w8whb\" (UID: \"d7b857fe-eaf9-42d2-af7c-7cace5e581b3\") " pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:05.889353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.889327    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7b857fe-eaf9-42d2-af7c-7cace5e581b3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-w8whb\" (UID: \"d7b857fe-eaf9-42d2-af7c-7cace5e581b3\") " pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:05.901418 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.901388    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jslz8\" (UniqueName: \"kubernetes.io/projected/d7b857fe-eaf9-42d2-af7c-7cace5e581b3-kube-api-access-jslz8\") pod \"payload-pre-processing-7964457696-w8whb\" (UID: \"d7b857fe-eaf9-42d2-af7c-7cace5e581b3\") " pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:05.995986 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:05.995950    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:06.056030 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:06.055945    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b45cfb7cb-q2z86" event={"ID":"8a61db4a-80b3-4f4d-aa1c-51e4019bf939","Type":"ContainerStarted","Data":"af45c7f36cc820a35e5c715dc51b83ae786fa4859607871fa99042cde32cae43"}
Jul 14 16:35:06.148954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:06.148889    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-w8whb"]
Jul 14 16:35:06.151568 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:35:06.151537    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b857fe_eaf9_42d2_af7c_7cace5e581b3.slice/crio-e1947b295a33f2e10ce3f956ef49866961abfe05e94989cc7aa3ca4e0a5747d1 WatchSource:0}: Error finding container e1947b295a33f2e10ce3f956ef49866961abfe05e94989cc7aa3ca4e0a5747d1: Status 404 returned error can't find the container with id e1947b295a33f2e10ce3f956ef49866961abfe05e94989cc7aa3ca4e0a5747d1
Jul 14 16:35:07.063659 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:07.063614    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-w8whb" event={"ID":"d7b857fe-eaf9-42d2-af7c-7cace5e581b3","Type":"ContainerStarted","Data":"e1947b295a33f2e10ce3f956ef49866961abfe05e94989cc7aa3ca4e0a5747d1"}
Jul 14 16:35:08.096040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:08.095996    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b45cfb7cb-q2z86" event={"ID":"8a61db4a-80b3-4f4d-aa1c-51e4019bf939","Type":"ContainerStarted","Data":"02ea41ac0550732f729978cd3817fed5194450264936beefba92c58655405038"}
Jul 14 16:35:08.096541 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:08.096207    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:08.136658 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:08.136602    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6b45cfb7cb-q2z86" podStartSLOduration=2.301598362 podStartE2EDuration="4.13658351s" totalImagesPullingTime="1.834985148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:08.135074589 +0000 UTC m=+541.914238527" watchObservedRunningTime="2026-07-14 16:35:08.13658351 +0000 UTC m=+541.915747451"
Jul 14 16:35:09.102608 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:09.102565    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-w8whb" event={"ID":"d7b857fe-eaf9-42d2-af7c-7cace5e581b3","Type":"ContainerStarted","Data":"edc8ce81c68fc3b39148bf853bb2dc1112944c314ff0a310ecb78aacfa92e035"}
Jul 14 16:35:09.155495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:09.155439    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-w8whb" podStartSLOduration=1.802765758 podStartE2EDuration="4.15541756s" totalImagesPullingTime="2.352651802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:09.154651511 +0000 UTC m=+542.933815447" watchObservedRunningTime="2026-07-14 16:35:09.15541756 +0000 UTC m=+542.934581492"
Jul 14 16:35:10.107426 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:10.107395    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:14.108297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:14.108266    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6b45cfb7cb-q2z86"
Jul 14 16:35:14.127219 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:14.127187    2574 generic.go:356] "Generic (PLEG): container finished" podID="b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4" containerID="b072e1c172c3e96d51e7603534050756686d8d8d4a8b1c79fd09fc0b5aa42f9c" exitCode=0
Jul 14 16:35:14.127390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:14.127255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" event={"ID":"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4","Type":"ContainerDied","Data":"b072e1c172c3e96d51e7603534050756686d8d8d4a8b1c79fd09fc0b5aa42f9c"}
Jul 14 16:35:14.127618 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:14.127603    2574 scope.go:117] "RemoveContainer" containerID="b072e1c172c3e96d51e7603534050756686d8d8d4a8b1c79fd09fc0b5aa42f9c"
Jul 14 16:35:14.128648 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:14.128620    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:35:14.128722 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:14.128705    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:35:14.128773 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:14.128755    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:35:15.133265 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:15.133230    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" event={"ID":"b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4","Type":"ContainerStarted","Data":"b53f10b2cb4293a3be8ec5faf854e8ec2ec690b906658b564cb266ce4df9fdb6"}
Jul 14 16:35:15.301358 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:15.301323    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:35:15.302595 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:15.302568    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jvbxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 14 16:35:15.302729 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:15.302620    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" podUID="b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 14 16:35:15.591587 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:15.591554    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:15.752252 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:15.752224    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:16.301646 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:16.301604    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jvbxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 14 16:35:16.302050 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:16.301688    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" podUID="b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 14 16:35:16.646178 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:16.646079    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:35:17.301865 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:17.301828    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jvbxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 14 16:35:17.302354 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:17.301886    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" podUID="b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 14 16:35:18.301431 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:18.301388    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jvbxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 14 16:35:18.301620 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:18.301469    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" podUID="b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 14 16:35:19.301903 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:19.301862    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jvbxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 14 16:35:19.302414 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:19.301944    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl" podUID="b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 14 16:35:20.305749 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:20.305713    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:35:20.306678 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:20.306659    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jvbxl"
Jul 14 16:35:21.113943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:21.113910    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-w8whb"
Jul 14 16:35:26.352807 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.352754    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"]
Jul 14 16:35:26.357000 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.356974    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.372669 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.372629    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-69gkh\""
Jul 14 16:35:26.372889 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.372694    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 16:35:26.372889 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.372741    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 14 16:35:26.372889 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.372744    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 16:35:26.373157 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.373137    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.373198 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.373168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.373233 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.373211    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.373269 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.373239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0665603-32de-4963-b880-b62293107a8b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.373269 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.373261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.373332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.373298    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnr86\" (UniqueName: \"kubernetes.io/projected/f0665603-32de-4963-b880-b62293107a8b-kube-api-access-hnr86\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.383050 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.383011    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"]
Jul 14 16:35:26.387967 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.387927    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:26.474073 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.474031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.474073 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.474077    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0665603-32de-4963-b880-b62293107a8b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.474328 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.474110    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.474328 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.474132    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnr86\" (UniqueName: \"kubernetes.io/projected/f0665603-32de-4963-b880-b62293107a8b-kube-api-access-hnr86\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.474328 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.474218    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.474328 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.474242    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.474480 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.474466    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.474563 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.474537    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.474610 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.474597    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.476641 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.476609    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0665603-32de-4963-b880-b62293107a8b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.476956 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.476937    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0665603-32de-4963-b880-b62293107a8b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.484927 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.484899    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnr86\" (UniqueName: \"kubernetes.io/projected/f0665603-32de-4963-b880-b62293107a8b-kube-api-access-hnr86\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9\" (UID: \"f0665603-32de-4963-b880-b62293107a8b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.668155 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.668053    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:26.823733 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:26.823696    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"]
Jul 14 16:35:26.827400 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:35:26.827361    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0665603_32de_4963_b880_b62293107a8b.slice/crio-023db2d2144cb9ea7246faacb144dddbb6297d36619ead5d50997fa06823643a WatchSource:0}: Error finding container 023db2d2144cb9ea7246faacb144dddbb6297d36619ead5d50997fa06823643a: Status 404 returned error can't find the container with id 023db2d2144cb9ea7246faacb144dddbb6297d36619ead5d50997fa06823643a
Jul 14 16:35:27.191214 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:27.191167    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9" event={"ID":"f0665603-32de-4963-b880-b62293107a8b","Type":"ContainerStarted","Data":"023db2d2144cb9ea7246faacb144dddbb6297d36619ead5d50997fa06823643a"}
Jul 14 16:35:31.211925 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:31.211884    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9" event={"ID":"f0665603-32de-4963-b880-b62293107a8b","Type":"ContainerStarted","Data":"c7fa4a1913499e4f4b98699396e08df5830fe27f6ae825603dfea36171f361fc"}
Jul 14 16:35:31.251274 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:31.251216    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9" podStartSLOduration=1.828403095 podStartE2EDuration="5.251199471s" totalImagesPullingTime="3.422796376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:31.250636377 +0000 UTC m=+565.029800313" watchObservedRunningTime="2026-07-14 16:35:31.251199471 +0000 UTC m=+565.030363461"
Jul 14 16:35:36.668519 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:36.668476    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:36.668957 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:36.668548    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:36.681041 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:36.681015    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:37.251222 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:37.251190    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9"
Jul 14 16:35:40.479129 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:40.479085    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:49.515685 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:49.515626    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:52.819530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.819494    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"]
Jul 14 16:35:52.822904 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.822884    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:52.826304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.826285    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 14 16:35:52.836246 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.836219    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"]
Jul 14 16:35:52.864259 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.864217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:52.900167 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.900125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:52.900167 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.900178    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pstwt\" (UniqueName: \"kubernetes.io/projected/2fc873c9-9fb0-4639-adf1-af000a7bdba6-kube-api-access-pstwt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:52.900396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.900206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:52.900396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.900222    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:52.900396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.900248    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fc873c9-9fb0-4639-adf1-af000a7bdba6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:52.900396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:52.900289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.001631 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.001594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.001631 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.001644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pstwt\" (UniqueName: \"kubernetes.io/projected/2fc873c9-9fb0-4639-adf1-af000a7bdba6-kube-api-access-pstwt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.001949 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.001867    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.001949 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.001909    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.002060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.001956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fc873c9-9fb0-4639-adf1-af000a7bdba6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.002060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.001990    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.002060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.001996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.002220 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.002164    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.002368 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.002348    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.004376 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.004353    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fc873c9-9fb0-4639-adf1-af000a7bdba6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.004601 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.004584    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fc873c9-9fb0-4639-adf1-af000a7bdba6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.010570 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.010544    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pstwt\" (UniqueName: \"kubernetes.io/projected/2fc873c9-9fb0-4639-adf1-af000a7bdba6-kube-api-access-pstwt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zzknm\" (UID: \"2fc873c9-9fb0-4639-adf1-af000a7bdba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.132868 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.132737    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:35:53.276894 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.276866    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"]
Jul 14 16:35:53.279326 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:35:53.279295    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc873c9_9fb0_4639_adf1_af000a7bdba6.slice/crio-76acc3662d105f27bc4749877ae36b58a33d0a57bdce33dbdd45d7b73e2b0dc1 WatchSource:0}: Error finding container 76acc3662d105f27bc4749877ae36b58a33d0a57bdce33dbdd45d7b73e2b0dc1: Status 404 returned error can't find the container with id 76acc3662d105f27bc4749877ae36b58a33d0a57bdce33dbdd45d7b73e2b0dc1
Jul 14 16:35:53.312932 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:53.312893    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm" event={"ID":"2fc873c9-9fb0-4639-adf1-af000a7bdba6","Type":"ContainerStarted","Data":"76acc3662d105f27bc4749877ae36b58a33d0a57bdce33dbdd45d7b73e2b0dc1"}
Jul 14 16:35:55.326378 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:55.326282    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm" event={"ID":"2fc873c9-9fb0-4639-adf1-af000a7bdba6","Type":"ContainerStarted","Data":"3848c2df3d7b8c6b5151a17afc362c87f248911392a26deba79da8b75029fb3b"}
Jul 14 16:35:55.344987 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:35:55.344930    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm" podStartSLOduration=1.608873382 podStartE2EDuration="3.344913513s" totalImagesPullingTime="1.736040131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:55.344105736 +0000 UTC m=+589.123269674" watchObservedRunningTime="2026-07-14 16:35:55.344913513 +0000 UTC m=+589.124077449"
Jul 14 16:36:03.133184 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:03.133137    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:36:03.133620 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:03.133211    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:36:03.145926 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:03.145899    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:36:03.379427 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:03.379394    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zzknm"
Jul 14 16:36:04.550665 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:04.550621    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:06.642926 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:06.642901    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:36:06.643377 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:06.642902    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:36:07.248803 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:07.248749    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:18.808057 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.808016    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"]
Jul 14 16:36:18.814026 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.813999    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.817247 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.817220    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 14 16:36:18.821857 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.821827    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"]
Jul 14 16:36:18.839285 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.839245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.839285 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.839285    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjdrf\" (UniqueName: \"kubernetes.io/projected/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-kube-api-access-pjdrf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.839530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.839305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.839530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.839330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.839530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.839363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.839530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.839479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.908529 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.908488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:18.940597 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.940554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.940758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.940628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.940758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.940686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.940896 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.940830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjdrf\" (UniqueName: \"kubernetes.io/projected/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-kube-api-access-pjdrf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.940896 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.940873    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.940996 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.940912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.941132 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.941107    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.941246 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.941227    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.941303 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.941291    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.943092 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.943072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.943374 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.943357    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:18.949125 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:18.949095    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjdrf\" (UniqueName: \"kubernetes.io/projected/f8d2a12e-e7fb-470b-95d1-06d780edb3b1-kube-api-access-pjdrf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx\" (UID: \"f8d2a12e-e7fb-470b-95d1-06d780edb3b1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:19.124745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:19.124645    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:19.267523 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:19.267492    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"]
Jul 14 16:36:19.269696 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:36:19.269671    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8d2a12e_e7fb_470b_95d1_06d780edb3b1.slice/crio-a92010854a8ed21cbb5d2339624fc4b6145b1b086d4ff819e64dd3ca97f11310 WatchSource:0}: Error finding container a92010854a8ed21cbb5d2339624fc4b6145b1b086d4ff819e64dd3ca97f11310: Status 404 returned error can't find the container with id a92010854a8ed21cbb5d2339624fc4b6145b1b086d4ff819e64dd3ca97f11310
Jul 14 16:36:19.271255 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:19.271230    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:36:19.439039 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:19.438956    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx" event={"ID":"f8d2a12e-e7fb-470b-95d1-06d780edb3b1","Type":"ContainerStarted","Data":"a92010854a8ed21cbb5d2339624fc4b6145b1b086d4ff819e64dd3ca97f11310"}
Jul 14 16:36:19.808671 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:19.808637    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:19.910334 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:19.910296    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:20.445277 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:20.445244    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx" event={"ID":"f8d2a12e-e7fb-470b-95d1-06d780edb3b1","Type":"ContainerStarted","Data":"b2a902023f96628bb2155f12646b368c1ec31c9831b2b77d640872e073ccac5a"}
Jul 14 16:36:20.464287 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:20.464225    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx" podStartSLOduration=2.274439394 podStartE2EDuration="2.464205927s" totalImagesPullingTime="189.766533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:36:20.46256044 +0000 UTC m=+614.241724377" watchObservedRunningTime="2026-07-14 16:36:20.464205927 +0000 UTC m=+614.243369901"
Jul 14 16:36:29.125262 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:29.125162    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:29.125262 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:29.125236    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:29.138023 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:29.137985    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:29.502244 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:29.502213    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx"
Jul 14 16:36:55.438026 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:36:55.437987    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:00.905812 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:00.905762    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fc944b4d8-q9b9q"]
Jul 14 16:37:00.909343 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:00.909324    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fc944b4d8-q9b9q"
Jul 14 16:37:00.918051 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:00.918024    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fc944b4d8-q9b9q"]
Jul 14 16:37:01.023947 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.023906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8m2t\" (UniqueName: \"kubernetes.io/projected/509d00f5-24b0-471c-9002-0e44c5b53f69-kube-api-access-c8m2t\") pod \"authorino-6fc944b4d8-q9b9q\" (UID: \"509d00f5-24b0-471c-9002-0e44c5b53f69\") " pod="kuadrant-system/authorino-6fc944b4d8-q9b9q"
Jul 14 16:37:01.024157 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.023976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/509d00f5-24b0-471c-9002-0e44c5b53f69-tls-cert\") pod \"authorino-6fc944b4d8-q9b9q\" (UID: \"509d00f5-24b0-471c-9002-0e44c5b53f69\") " pod="kuadrant-system/authorino-6fc944b4d8-q9b9q"
Jul 14 16:37:01.124480 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.124436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/509d00f5-24b0-471c-9002-0e44c5b53f69-tls-cert\") pod \"authorino-6fc944b4d8-q9b9q\" (UID: \"509d00f5-24b0-471c-9002-0e44c5b53f69\") " pod="kuadrant-system/authorino-6fc944b4d8-q9b9q"
Jul 14 16:37:01.124670 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.124527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8m2t\" (UniqueName: \"kubernetes.io/projected/509d00f5-24b0-471c-9002-0e44c5b53f69-kube-api-access-c8m2t\") pod \"authorino-6fc944b4d8-q9b9q\" (UID: \"509d00f5-24b0-471c-9002-0e44c5b53f69\") " pod="kuadrant-system/authorino-6fc944b4d8-q9b9q"
Jul 14 16:37:01.127153 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.127120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/509d00f5-24b0-471c-9002-0e44c5b53f69-tls-cert\") pod \"authorino-6fc944b4d8-q9b9q\" (UID: \"509d00f5-24b0-471c-9002-0e44c5b53f69\") " pod="kuadrant-system/authorino-6fc944b4d8-q9b9q"
Jul 14 16:37:01.134331 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.134301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8m2t\" (UniqueName: \"kubernetes.io/projected/509d00f5-24b0-471c-9002-0e44c5b53f69-kube-api-access-c8m2t\") pod \"authorino-6fc944b4d8-q9b9q\" (UID: \"509d00f5-24b0-471c-9002-0e44c5b53f69\") " pod="kuadrant-system/authorino-6fc944b4d8-q9b9q"
Jul 14 16:37:01.220224 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.220131    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fc944b4d8-q9b9q"
Jul 14 16:37:01.373277 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.373211    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fc944b4d8-q9b9q"]
Jul 14 16:37:01.375857 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:37:01.375829    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod509d00f5_24b0_471c_9002_0e44c5b53f69.slice/crio-580e782656e28ad221887a79e27735a2fca9f03ba3a3aac9951590f9f871a581 WatchSource:0}: Error finding container 580e782656e28ad221887a79e27735a2fca9f03ba3a3aac9951590f9f871a581: Status 404 returned error can't find the container with id 580e782656e28ad221887a79e27735a2fca9f03ba3a3aac9951590f9f871a581
Jul 14 16:37:01.392972 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.392932    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:01.486370 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.486271    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:01.642855 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:01.642819    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fc944b4d8-q9b9q" event={"ID":"509d00f5-24b0-471c-9002-0e44c5b53f69","Type":"ContainerStarted","Data":"580e782656e28ad221887a79e27735a2fca9f03ba3a3aac9951590f9f871a581"}
Jul 14 16:37:02.610485 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:02.610428    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:02.650262 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:02.650214    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fc944b4d8-q9b9q" event={"ID":"509d00f5-24b0-471c-9002-0e44c5b53f69","Type":"ContainerStarted","Data":"af2e0331a597467c278502bbcab54b12d520ae83f5c84d6b4e7c7c54299118c5"}
Jul 14 16:37:02.669306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:02.669010    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6fc944b4d8-q9b9q" podStartSLOduration=2.101033426 podStartE2EDuration="2.668991307s" totalImagesPullingTime="567.957881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:02.668453392 +0000 UTC m=+656.447617333" watchObservedRunningTime="2026-07-14 16:37:02.668991307 +0000 UTC m=+656.448155243"
Jul 14 16:37:02.697062 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:02.697016    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b6884fcfc-tmmxp"]
Jul 14 16:37:02.697576 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:02.697542    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp" podUID="2f73e05e-739f-45fa-ae6d-2a5fe69b55e5" containerName="authorino" containerID="cri-o://c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c" gracePeriod=30
Jul 14 16:37:02.712222 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:02.708904    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:02.971791 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:02.971753    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:37:03.145972 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.145884    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-tls-cert\") pod \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\" (UID: \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\") "
Jul 14 16:37:03.145972 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.145942    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjcr9\" (UniqueName: \"kubernetes.io/projected/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-kube-api-access-qjcr9\") pod \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\" (UID: \"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5\") "
Jul 14 16:37:03.148245 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.148211    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-kube-api-access-qjcr9" (OuterVolumeSpecName: "kube-api-access-qjcr9") pod "2f73e05e-739f-45fa-ae6d-2a5fe69b55e5" (UID: "2f73e05e-739f-45fa-ae6d-2a5fe69b55e5"). InnerVolumeSpecName "kube-api-access-qjcr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:37:03.158102 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.158065    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2f73e05e-739f-45fa-ae6d-2a5fe69b55e5" (UID: "2f73e05e-739f-45fa-ae6d-2a5fe69b55e5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:37:03.247334 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.247291    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjcr9\" (UniqueName: \"kubernetes.io/projected/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-kube-api-access-qjcr9\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:37:03.247334 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.247328    2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5-tls-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:37:03.655980 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.655932    2574 generic.go:356] "Generic (PLEG): container finished" podID="2f73e05e-739f-45fa-ae6d-2a5fe69b55e5" containerID="c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c" exitCode=0
Jul 14 16:37:03.655980 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.655978    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp"
Jul 14 16:37:03.656466 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.656082    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp" event={"ID":"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5","Type":"ContainerDied","Data":"c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c"}
Jul 14 16:37:03.656466 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.656134    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b6884fcfc-tmmxp" event={"ID":"2f73e05e-739f-45fa-ae6d-2a5fe69b55e5","Type":"ContainerDied","Data":"b0676b368344192f156c9d2cee9e93b14c4e9b785ed121261c0bb51123227fb1"}
Jul 14 16:37:03.656466 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.656159    2574 scope.go:117] "RemoveContainer" containerID="c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c"
Jul 14 16:37:03.666142 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.666115    2574 scope.go:117] "RemoveContainer" containerID="c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c"
Jul 14 16:37:03.667774 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:37:03.667742    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c\": container with ID starting with c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c not found: ID does not exist" containerID="c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c"
Jul 14 16:37:03.667943 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.667808    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c"} err="failed to get container status \"c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c\": rpc error: code = NotFound desc = could not find container \"c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c\": container with ID starting with c5a1b190aa873d2e146396eaad21bc30bb03de7249ebf63a988acef5bdb43f9c not found: ID does not exist"
Jul 14 16:37:03.717283 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.717241    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b6884fcfc-tmmxp"]
Jul 14 16:37:03.730061 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:03.730023    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b6884fcfc-tmmxp"]
Jul 14 16:37:04.756062 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:04.756027    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f73e05e-739f-45fa-ae6d-2a5fe69b55e5" path="/var/lib/kubelet/pods/2f73e05e-739f-45fa-ae6d-2a5fe69b55e5/volumes"
Jul 14 16:37:48.669143 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:48.669102    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:48.769614 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:37:48.769574    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:13.866863 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:13.866822    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:15.466006 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:15.465963    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:38.168015 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:38.167976    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:45.162868 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:45.162815    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:45.263806 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:45.263737    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:51.420286 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:51.420242    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:51.516177 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:51.516125    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:51.778808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:51.778744    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:57.836394 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:57.836353    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:57.904895 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:57.904856    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:57.988161 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:57.988116    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:38:58.229056 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:38:58.228962    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:39:03.294987 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:39:03.294948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:39:03.367639 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:39:03.367597    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:39:04.246708 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:39:04.246669    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:39:04.348122 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:39:04.348078    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:41:06.670382 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:41:06.670350    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:41:06.670382 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:41:06.670387    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:41:06.761133 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:41:06.761100    2574 scope.go:117] "RemoveContainer" containerID="f54461792ff0644eecf364c4317bb571961d32bcc394833b0407df6161cafa73"
Jul 14 16:43:53.626117 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:43:53.626083    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:45:34.044169 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:45:34.044089    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:46:06.697720 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:46:06.697693    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:46:06.700157 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:46:06.699207    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:46:18.248958 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:46:18.248908    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:46:18.322845 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:46:18.322768    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:46:41.494502 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:46:41.494459    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:49:56.932569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:49:56.932478    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:03.434721 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:03.434677    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:11.688239 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:11.688204    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:16.812807 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:16.812742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:19.822157 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:19.822119    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:19.921529 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:19.921488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:20.309632 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:20.309588    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:26.144615 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.144575    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:26.212797 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.212749    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:26.332234 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.332202    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"]
Jul 14 16:50:26.332651 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.332632    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f73e05e-739f-45fa-ae6d-2a5fe69b55e5" containerName="authorino"
Jul 14 16:50:26.332738 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.332655    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f73e05e-739f-45fa-ae6d-2a5fe69b55e5" containerName="authorino"
Jul 14 16:50:26.332816 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.332766    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f73e05e-739f-45fa-ae6d-2a5fe69b55e5" containerName="authorino"
Jul 14 16:50:26.335734 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.335711    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.338158 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.338133    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d4540498-openshift-default-dockercfg-zbk4j\""
Jul 14 16:50:26.359099 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.359056    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"]
Jul 14 16:50:26.361680 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.361637    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:26.402261 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.402155    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-socket\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.402261 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.402198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-data\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.402261 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.402223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istiod-ca-cert\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.402261 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.402245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9rmf\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-kube-api-access-f9rmf\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.402569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.402324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-podinfo\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.402569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.402355    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-credential-socket\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.402569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.402419    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-token\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.402569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.402475    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-envoy\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.402569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.402504    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-certs\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.503458 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-certs\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.503653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503471    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-socket\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.503653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-data\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.503653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503504    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istiod-ca-cert\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.503653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503521    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9rmf\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-kube-api-access-f9rmf\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.503653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503584    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-podinfo\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.503653 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503615    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-credential-socket\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.504021 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503729    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-token\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.504021 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-envoy\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.504021 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503940    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-data\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.504021 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.503965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-certs\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.504200 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.504170    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-socket\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.504274 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.504254    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-credential-socket\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.504367 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.504348    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istiod-ca-cert\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.506181 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.506157    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-envoy\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.506366 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.506346    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-podinfo\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.512352 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.512330    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9rmf\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-kube-api-access-f9rmf\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.512455 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.512337    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-token\") pod \"e2e-ait-d4540498-openshift-default-6fd694c799-2l684\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") " pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.648797 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.648739    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:26.664513 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.664481    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:26.802741 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.802711    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"]
Jul 14 16:50:26.804984 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:50:26.804936    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b256a7e_5de7_4648_a3cb_d5f1f08e4f07.slice/crio-9431e0e8dd2d2f28ea1b107c27c487206b8b972b1cf301cf0136e56a83d0f368 WatchSource:0}: Error finding container 9431e0e8dd2d2f28ea1b107c27c487206b8b972b1cf301cf0136e56a83d0f368: Status 404 returned error can't find the container with id 9431e0e8dd2d2f28ea1b107c27c487206b8b972b1cf301cf0136e56a83d0f368
Jul 14 16:50:26.807201 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.807167    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:50:26.807310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.807240    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:50:26.807310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:26.807270    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:50:27.571410 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.571343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:27.578303 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.578268    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684" event={"ID":"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07","Type":"ContainerStarted","Data":"b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964"}
Jul 14 16:50:27.578514 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.578333    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684" event={"ID":"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07","Type":"ContainerStarted","Data":"9431e0e8dd2d2f28ea1b107c27c487206b8b972b1cf301cf0136e56a83d0f368"}
Jul 14 16:50:27.603849 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.603798    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684" podStartSLOduration=1.6037627749999999 podStartE2EDuration="1.603762775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:50:27.602076806 +0000 UTC m=+1461.381240742" watchObservedRunningTime="2026-07-14 16:50:27.603762775 +0000 UTC m=+1461.382926734"
Jul 14 16:50:27.649496 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.649465    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:27.650594 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.650561    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"]
Jul 14 16:50:27.654167 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.654144    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.655483 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.655460    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:27.656676 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.656661    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-d4540498-serving-cert\""
Jul 14 16:50:27.664714 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.664688    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"]
Jul 14 16:50:27.672396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.672355    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:27.714999 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.714960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3df8bb44-8aa7-42a8-8a3d-13c83995b764-maas-api-tls\") pod \"maas-api-e2e-ait-d4540498-74c895697-4m85n\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") " pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.714999 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.715012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3df8bb44-8aa7-42a8-8a3d-13c83995b764-openshift-service-ca\") pod \"maas-api-e2e-ait-d4540498-74c895697-4m85n\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") " pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.715230 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.715099    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxq74\" (UniqueName: \"kubernetes.io/projected/3df8bb44-8aa7-42a8-8a3d-13c83995b764-kube-api-access-cxq74\") pod \"maas-api-e2e-ait-d4540498-74c895697-4m85n\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") " pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.742245 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.742202    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:27.816278 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.816231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3df8bb44-8aa7-42a8-8a3d-13c83995b764-maas-api-tls\") pod \"maas-api-e2e-ait-d4540498-74c895697-4m85n\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") " pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.816481 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.816286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3df8bb44-8aa7-42a8-8a3d-13c83995b764-openshift-service-ca\") pod \"maas-api-e2e-ait-d4540498-74c895697-4m85n\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") " pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.816481 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.816347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxq74\" (UniqueName: \"kubernetes.io/projected/3df8bb44-8aa7-42a8-8a3d-13c83995b764-kube-api-access-cxq74\") pod \"maas-api-e2e-ait-d4540498-74c895697-4m85n\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") " pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.817129 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.817105    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3df8bb44-8aa7-42a8-8a3d-13c83995b764-openshift-service-ca\") pod \"maas-api-e2e-ait-d4540498-74c895697-4m85n\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") " pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.819171 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.819149    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3df8bb44-8aa7-42a8-8a3d-13c83995b764-maas-api-tls\") pod \"maas-api-e2e-ait-d4540498-74c895697-4m85n\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") " pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.827946 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.827884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxq74\" (UniqueName: \"kubernetes.io/projected/3df8bb44-8aa7-42a8-8a3d-13c83995b764-kube-api-access-cxq74\") pod \"maas-api-e2e-ait-d4540498-74c895697-4m85n\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") " pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:27.867320 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.867281    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:27.966317 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:27.966279    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:28.113483 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:28.113445    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"]
Jul 14 16:50:28.114589 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:50:28.114556    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df8bb44_8aa7_42a8_8a3d_13c83995b764.slice/crio-7e79772e60348b75bc557156e4b1ce42a8076f9c6ba3f2e03537209ff0f3dc5c WatchSource:0}: Error finding container 7e79772e60348b75bc557156e4b1ce42a8076f9c6ba3f2e03537209ff0f3dc5c: Status 404 returned error can't find the container with id 7e79772e60348b75bc557156e4b1ce42a8076f9c6ba3f2e03537209ff0f3dc5c
Jul 14 16:50:28.116166 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:28.116144    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:50:28.129285 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:28.129232    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:28.250814 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:28.250749    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:28.583933 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:28.583898    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n" event={"ID":"3df8bb44-8aa7-42a8-8a3d-13c83995b764","Type":"ContainerStarted","Data":"7e79772e60348b75bc557156e4b1ce42a8076f9c6ba3f2e03537209ff0f3dc5c"}
Jul 14 16:50:28.584323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:28.584122    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:28.585270 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:28.585249    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:29.591859 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:29.591818    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n" event={"ID":"3df8bb44-8aa7-42a8-8a3d-13c83995b764","Type":"ContainerStarted","Data":"6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8"}
Jul 14 16:50:29.592336 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:29.591909    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:29.609960 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:29.609906    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n" podStartSLOduration=1.357806522 podStartE2EDuration="2.609888095s" totalImagesPullingTime="1.252081573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:50:29.609122615 +0000 UTC m=+1463.388286556" watchObservedRunningTime="2026-07-14 16:50:29.609888095 +0000 UTC m=+1463.389052031"
Jul 14 16:50:30.023491 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:30.023438    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:32.740547 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:32.740509    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:32.905423 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:32.905380    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"]
Jul 14 16:50:32.905635 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:32.905604    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684" podUID="5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" containerName="istio-proxy" containerID="cri-o://b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964" gracePeriod=30
Jul 14 16:50:32.929897 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:32.929854    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:33.031595 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.031559    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"]
Jul 14 16:50:33.031836 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.031805    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n" podUID="3df8bb44-8aa7-42a8-8a3d-13c83995b764" containerName="maas-api" containerID="cri-o://6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8" gracePeriod=30
Jul 14 16:50:33.044095 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.044061    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:33.111887 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.111851    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:33.288859 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.288771    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:33.371151 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.371111    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3df8bb44-8aa7-42a8-8a3d-13c83995b764-openshift-service-ca\") pod \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") "
Jul 14 16:50:33.371332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.371180    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxq74\" (UniqueName: \"kubernetes.io/projected/3df8bb44-8aa7-42a8-8a3d-13c83995b764-kube-api-access-cxq74\") pod \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") "
Jul 14 16:50:33.371332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.371322    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3df8bb44-8aa7-42a8-8a3d-13c83995b764-maas-api-tls\") pod \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\" (UID: \"3df8bb44-8aa7-42a8-8a3d-13c83995b764\") "
Jul 14 16:50:33.371577 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.371554    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df8bb44-8aa7-42a8-8a3d-13c83995b764-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3df8bb44-8aa7-42a8-8a3d-13c83995b764" (UID: "3df8bb44-8aa7-42a8-8a3d-13c83995b764"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:50:33.371681 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.371656    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3df8bb44-8aa7-42a8-8a3d-13c83995b764-openshift-service-ca\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:33.373655 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.373628    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3df8bb44-8aa7-42a8-8a3d-13c83995b764-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3df8bb44-8aa7-42a8-8a3d-13c83995b764" (UID: "3df8bb44-8aa7-42a8-8a3d-13c83995b764"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:50:33.373746 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.373654    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3df8bb44-8aa7-42a8-8a3d-13c83995b764-kube-api-access-cxq74" (OuterVolumeSpecName: "kube-api-access-cxq74") pod "3df8bb44-8aa7-42a8-8a3d-13c83995b764" (UID: "3df8bb44-8aa7-42a8-8a3d-13c83995b764"). InnerVolumeSpecName "kube-api-access-cxq74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:50:33.472397 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.472358    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxq74\" (UniqueName: \"kubernetes.io/projected/3df8bb44-8aa7-42a8-8a3d-13c83995b764-kube-api-access-cxq74\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:33.472397 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.472398    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3df8bb44-8aa7-42a8-8a3d-13c83995b764-maas-api-tls\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:33.613568 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.613472    2574 generic.go:356] "Generic (PLEG): container finished" podID="3df8bb44-8aa7-42a8-8a3d-13c83995b764" containerID="6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8" exitCode=0
Jul 14 16:50:33.613568 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.613521    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"
Jul 14 16:50:33.613844 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.613570    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n" event={"ID":"3df8bb44-8aa7-42a8-8a3d-13c83995b764","Type":"ContainerDied","Data":"6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8"}
Jul 14 16:50:33.613844 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.613630    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n" event={"ID":"3df8bb44-8aa7-42a8-8a3d-13c83995b764","Type":"ContainerDied","Data":"7e79772e60348b75bc557156e4b1ce42a8076f9c6ba3f2e03537209ff0f3dc5c"}
Jul 14 16:50:33.613844 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.613659    2574 scope.go:117] "RemoveContainer" containerID="6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8"
Jul 14 16:50:33.630030 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.630010    2574 scope.go:117] "RemoveContainer" containerID="6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8"
Jul 14 16:50:33.630357 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:50:33.630331    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8\": container with ID starting with 6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8 not found: ID does not exist" containerID="6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8"
Jul 14 16:50:33.630453 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.630363    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8"} err="failed to get container status \"6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8\": rpc error: code = NotFound desc = could not find container \"6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8\": container with ID starting with 6f56c65059577c7456e758ccec8176fa9fab5f77eceee5b285b6507925e7a5a8 not found: ID does not exist"
Jul 14 16:50:33.645679 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.645644    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"]
Jul 14 16:50:33.649853 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:33.649820    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-d4540498-74c895697-4m85n"]
Jul 14 16:50:34.756396 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:34.756361    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3df8bb44-8aa7-42a8-8a3d-13c83995b764" path="/var/lib/kubelet/pods/3df8bb44-8aa7-42a8-8a3d-13c83995b764/volumes"
Jul 14 16:50:36.392199 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:36.392164    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:38.164630 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.164551    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:38.317859 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.317817    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istiod-ca-cert\") pod \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") "
Jul 14 16:50:38.318069 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.317879    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-podinfo\") pod \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") "
Jul 14 16:50:38.318069 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.317941    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-envoy\") pod \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") "
Jul 14 16:50:38.318069 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.317967    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9rmf\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-kube-api-access-f9rmf\") pod \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") "
Jul 14 16:50:38.318069 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.317987    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-certs\") pod \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") "
Jul 14 16:50:38.318069 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318020    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-socket\") pod \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") "
Jul 14 16:50:38.318335 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318147    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-credential-socket\") pod \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") "
Jul 14 16:50:38.318335 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318224    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-token\") pod \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") "
Jul 14 16:50:38.318335 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318262    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-data\") pod \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\" (UID: \"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07\") "
Jul 14 16:50:38.318484 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318347    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" (UID: "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:38.318484 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318338    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" (UID: "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:38.318484 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318360    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" (UID: "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:50:38.318636 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318537    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" (UID: "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:38.318712 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318627    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" (UID: "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:38.318712 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318644    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:38.318712 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318673    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-credential-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:38.318712 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318688    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istiod-ca-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:38.318712 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.318698    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-workload-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:38.320390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.320361    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" (UID: "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:50:38.320576 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.320553    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" (UID: "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:38.320966 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.320938    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" (UID: "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:50:38.321066 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.320961    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-kube-api-access-f9rmf" (OuterVolumeSpecName: "kube-api-access-f9rmf") pod "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" (UID: "5b256a7e-5de7-4648-a3cb-d5f1f08e4f07"). InnerVolumeSpecName "kube-api-access-f9rmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:50:38.419888 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.419755    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-envoy\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:38.419888 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.419824    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9rmf\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-kube-api-access-f9rmf\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:38.419888 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.419835    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:38.419888 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.419844    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-data\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:38.419888 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.419852    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07-istio-podinfo\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:38.640751 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.640714    2574 generic.go:356] "Generic (PLEG): container finished" podID="5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" containerID="b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964" exitCode=0
Jul 14 16:50:38.640913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.640765    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"
Jul 14 16:50:38.640913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.640771    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684" event={"ID":"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07","Type":"ContainerDied","Data":"b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964"}
Jul 14 16:50:38.640913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.640836    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684" event={"ID":"5b256a7e-5de7-4648-a3cb-d5f1f08e4f07","Type":"ContainerDied","Data":"9431e0e8dd2d2f28ea1b107c27c487206b8b972b1cf301cf0136e56a83d0f368"}
Jul 14 16:50:38.640913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.640858    2574 scope.go:117] "RemoveContainer" containerID="b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964"
Jul 14 16:50:38.650803 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.650763    2574 scope.go:117] "RemoveContainer" containerID="b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964"
Jul 14 16:50:38.651126 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:50:38.651106    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964\": container with ID starting with b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964 not found: ID does not exist" containerID="b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964"
Jul 14 16:50:38.651176 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.651138    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964"} err="failed to get container status \"b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964\": rpc error: code = NotFound desc = could not find container \"b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964\": container with ID starting with b740a7ed716c45df6c0f42a0b4e623bd1c3cf1a2a7042c66276cf802e721b964 not found: ID does not exist"
Jul 14 16:50:38.663018 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.662983    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"]
Jul 14 16:50:38.667040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.667002    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d4540498-openshift-default-6fd694c799-2l684"]
Jul 14 16:50:38.756171 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:38.756140    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" path="/var/lib/kubelet/pods/5b256a7e-5de7-4648-a3cb-d5f1f08e4f07/volumes"
Jul 14 16:50:39.122603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.122508    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"]
Jul 14 16:50:39.122946 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.122929    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3df8bb44-8aa7-42a8-8a3d-13c83995b764" containerName="maas-api"
Jul 14 16:50:39.122946 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.122946    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3df8bb44-8aa7-42a8-8a3d-13c83995b764" containerName="maas-api"
Jul 14 16:50:39.123077 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.122958    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" containerName="istio-proxy"
Jul 14 16:50:39.123077 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.122966    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" containerName="istio-proxy"
Jul 14 16:50:39.123077 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.123050    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b256a7e-5de7-4648-a3cb-d5f1f08e4f07" containerName="istio-proxy"
Jul 14 16:50:39.123077 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.123063    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3df8bb44-8aa7-42a8-8a3d-13c83995b764" containerName="maas-api"
Jul 14 16:50:39.127649 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.127617    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.131205 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.131012    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-236b761c-openshift-default-dockercfg-kbs5t\""
Jul 14 16:50:39.141040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.141012    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"]
Jul 14 16:50:39.227109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.227062    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-data\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.227109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.227102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-podinfo\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.227623 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.227124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-credential-socket\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.227623 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.227168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6jrb\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-kube-api-access-g6jrb\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.227623 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.227220    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-socket\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.227623 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.227291    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-envoy\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.227623 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.227347    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-certs\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.227623 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.227386    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istiod-ca-cert\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.227623 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.227424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-token\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.328275 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-socket\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.328275 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-envoy\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.328551 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328306    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-certs\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.328551 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istiod-ca-cert\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.328551 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-token\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.328551 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328418    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-data\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.328551 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-podinfo\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.328551 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-credential-socket\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.328551 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6jrb\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-kube-api-access-g6jrb\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.329064 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328676    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-socket\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.329064 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328723    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-certs\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.329064 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-credential-socket\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.329064 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.328974    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-data\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.329213 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.329105    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istiod-ca-cert\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.330993 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.330962    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-envoy\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.331167 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.331149    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-podinfo\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.338638 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.338609    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6jrb\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-kube-api-access-g6jrb\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.339209 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.339184    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-token\") pod \"e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") " pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.442511 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.442406    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:39.599799 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.599746    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"]
Jul 14 16:50:39.601202 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:50:39.601168    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc4f6e6_f989_43c3_a6c6_9b1e0f02f82a.slice/crio-f89f66b2c29e145e66401c25d63409c54ec6346a7ab5c91998962775794939b5 WatchSource:0}: Error finding container f89f66b2c29e145e66401c25d63409c54ec6346a7ab5c91998962775794939b5: Status 404 returned error can't find the container with id f89f66b2c29e145e66401c25d63409c54ec6346a7ab5c91998962775794939b5
Jul 14 16:50:39.603482 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.603432    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:50:39.603590 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.603552    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:50:39.603648 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.603601    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:50:39.648913 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.648879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg" event={"ID":"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a","Type":"ContainerStarted","Data":"f89f66b2c29e145e66401c25d63409c54ec6346a7ab5c91998962775794939b5"}
Jul 14 16:50:39.677016 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.676977    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:39.778626 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:39.778582    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:40.412948 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.412871    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:40.513964 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.513923    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"]
Jul 14 16:50:40.518080 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.518029    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:40.521563 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.521537    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-236b761c-serving-cert\""
Jul 14 16:50:40.547030 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.546988    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"]
Jul 14 16:50:40.596747 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.596713    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:40.642062 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.642006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38229f3-c438-40d5-a0ba-17a973813c61-maas-api-tls\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:40.642280 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.642069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38229f3-c438-40d5-a0ba-17a973813c61-openshift-service-ca\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:40.642365 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.642285    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82wc6\" (UniqueName: \"kubernetes.io/projected/b38229f3-c438-40d5-a0ba-17a973813c61-kube-api-access-82wc6\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:40.657228 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.657189    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg" event={"ID":"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a","Type":"ContainerStarted","Data":"38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db"}
Jul 14 16:50:40.707221 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.707109    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg" podStartSLOduration=1.707091092 podStartE2EDuration="1.707091092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:50:40.705876955 +0000 UTC m=+1474.485040892" watchObservedRunningTime="2026-07-14 16:50:40.707091092 +0000 UTC m=+1474.486255028"
Jul 14 16:50:40.722880 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.722845    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:40.743827 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.743758    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82wc6\" (UniqueName: \"kubernetes.io/projected/b38229f3-c438-40d5-a0ba-17a973813c61-kube-api-access-82wc6\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:40.744031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.743896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38229f3-c438-40d5-a0ba-17a973813c61-maas-api-tls\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:40.744031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.743922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38229f3-c438-40d5-a0ba-17a973813c61-openshift-service-ca\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:40.744031 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:50:40.744015    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-236b761c-serving-cert: secret "maas-api-e2e-ait-236b761c-serving-cert" not found
Jul 14 16:50:40.744180 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:50:40.744080    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b38229f3-c438-40d5-a0ba-17a973813c61-maas-api-tls podName:b38229f3-c438-40d5-a0ba-17a973813c61 nodeName:}" failed. No retries permitted until 2026-07-14 16:50:41.244058748 +0000 UTC m=+1475.023222682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b38229f3-c438-40d5-a0ba-17a973813c61-maas-api-tls") pod "maas-api-e2e-ait-236b761c-b7d676499-x4hlp" (UID: "b38229f3-c438-40d5-a0ba-17a973813c61") : secret "maas-api-e2e-ait-236b761c-serving-cert" not found
Jul 14 16:50:40.744698 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.744668    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38229f3-c438-40d5-a0ba-17a973813c61-openshift-service-ca\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:40.762959 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.762922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82wc6\" (UniqueName: \"kubernetes.io/projected/b38229f3-c438-40d5-a0ba-17a973813c61-kube-api-access-82wc6\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:40.945607 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:40.945570    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:41.066527 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.066493    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:41.170094 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.170063    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:41.248426 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.248381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38229f3-c438-40d5-a0ba-17a973813c61-maas-api-tls\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:41.251028 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.251004    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38229f3-c438-40d5-a0ba-17a973813c61-maas-api-tls\") pod \"maas-api-e2e-ait-236b761c-b7d676499-x4hlp\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") " pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:41.430460 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.430365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:41.443605 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.443575    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:41.449373 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.449337    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:41.575218 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.575182    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"]
Jul 14 16:50:41.577190 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:50:41.577162    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38229f3_c438_40d5_a0ba_17a973813c61.slice/crio-65f1c6e685eadc7cecbe358f42deb3716edbcd4b1d3060b43474b9130fe05eaf WatchSource:0}: Error finding container 65f1c6e685eadc7cecbe358f42deb3716edbcd4b1d3060b43474b9130fe05eaf: Status 404 returned error can't find the container with id 65f1c6e685eadc7cecbe358f42deb3716edbcd4b1d3060b43474b9130fe05eaf
Jul 14 16:50:41.663441 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.663410    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp" event={"ID":"b38229f3-c438-40d5-a0ba-17a973813c61","Type":"ContainerStarted","Data":"65f1c6e685eadc7cecbe358f42deb3716edbcd4b1d3060b43474b9130fe05eaf"}
Jul 14 16:50:41.663612 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.663587    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:41.664521 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:41.664503    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:42.357980 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:42.357944    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:42.669708 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:42.669612    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp" event={"ID":"b38229f3-c438-40d5-a0ba-17a973813c61","Type":"ContainerStarted","Data":"49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18"}
Jul 14 16:50:42.687163 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:42.686999    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp" podStartSLOduration=2.372509764 podStartE2EDuration="2.686979973s" totalImagesPullingTime="314.470209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:50:42.686840043 +0000 UTC m=+1476.466003979" watchObservedRunningTime="2026-07-14 16:50:42.686979973 +0000 UTC m=+1476.466143911"
Jul 14 16:50:43.674580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:43.674550    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:45.554568 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:45.554523    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:45.849293 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:45.849192    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"]
Jul 14 16:50:45.849481 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:45.849433    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp" podUID="b38229f3-c438-40d5-a0ba-17a973813c61" containerName="maas-api" containerID="cri-o://49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18" gracePeriod=30
Jul 14 16:50:45.893304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:45.893271    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:46.105524 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.105453    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:46.193675 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.193634    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38229f3-c438-40d5-a0ba-17a973813c61-maas-api-tls\") pod \"b38229f3-c438-40d5-a0ba-17a973813c61\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") "
Jul 14 16:50:46.193891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.193719    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82wc6\" (UniqueName: \"kubernetes.io/projected/b38229f3-c438-40d5-a0ba-17a973813c61-kube-api-access-82wc6\") pod \"b38229f3-c438-40d5-a0ba-17a973813c61\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") "
Jul 14 16:50:46.193891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.193814    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38229f3-c438-40d5-a0ba-17a973813c61-openshift-service-ca\") pod \"b38229f3-c438-40d5-a0ba-17a973813c61\" (UID: \"b38229f3-c438-40d5-a0ba-17a973813c61\") "
Jul 14 16:50:46.194180 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.194152    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b38229f3-c438-40d5-a0ba-17a973813c61-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b38229f3-c438-40d5-a0ba-17a973813c61" (UID: "b38229f3-c438-40d5-a0ba-17a973813c61"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:50:46.196091 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.196067    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b38229f3-c438-40d5-a0ba-17a973813c61-kube-api-access-82wc6" (OuterVolumeSpecName: "kube-api-access-82wc6") pod "b38229f3-c438-40d5-a0ba-17a973813c61" (UID: "b38229f3-c438-40d5-a0ba-17a973813c61"). InnerVolumeSpecName "kube-api-access-82wc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:50:46.196205 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.196095    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b38229f3-c438-40d5-a0ba-17a973813c61-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b38229f3-c438-40d5-a0ba-17a973813c61" (UID: "b38229f3-c438-40d5-a0ba-17a973813c61"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:50:46.295339 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.295298    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38229f3-c438-40d5-a0ba-17a973813c61-maas-api-tls\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:46.295339 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.295341    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82wc6\" (UniqueName: \"kubernetes.io/projected/b38229f3-c438-40d5-a0ba-17a973813c61-kube-api-access-82wc6\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:46.295544 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.295357    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38229f3-c438-40d5-a0ba-17a973813c61-openshift-service-ca\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:46.693112 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.693076    2574 generic.go:356] "Generic (PLEG): container finished" podID="b38229f3-c438-40d5-a0ba-17a973813c61" containerID="49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18" exitCode=0
Jul 14 16:50:46.693601 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.693119    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"
Jul 14 16:50:46.693601 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.693168    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp" event={"ID":"b38229f3-c438-40d5-a0ba-17a973813c61","Type":"ContainerDied","Data":"49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18"}
Jul 14 16:50:46.693601 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.693232    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp" event={"ID":"b38229f3-c438-40d5-a0ba-17a973813c61","Type":"ContainerDied","Data":"65f1c6e685eadc7cecbe358f42deb3716edbcd4b1d3060b43474b9130fe05eaf"}
Jul 14 16:50:46.693601 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.693270    2574 scope.go:117] "RemoveContainer" containerID="49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18"
Jul 14 16:50:46.703060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.703035    2574 scope.go:117] "RemoveContainer" containerID="49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18"
Jul 14 16:50:46.703385 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:50:46.703363    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18\": container with ID starting with 49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18 not found: ID does not exist" containerID="49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18"
Jul 14 16:50:46.703474 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.703394    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18"} err="failed to get container status \"49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18\": rpc error: code = NotFound desc = could not find container \"49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18\": container with ID starting with 49c585fd2f6e60ce4645c836eafeeee9849351788191bd27e0b56fb54e27bd18 not found: ID does not exist"
Jul 14 16:50:46.716372 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.716339    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"]
Jul 14 16:50:46.718093 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.718070    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-236b761c-b7d676499-x4hlp"]
Jul 14 16:50:46.757025 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:46.756993    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b38229f3-c438-40d5-a0ba-17a973813c61" path="/var/lib/kubelet/pods/b38229f3-c438-40d5-a0ba-17a973813c61/volumes"
Jul 14 16:50:51.908439 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:51.908402    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"]
Jul 14 16:50:51.908914 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:51.908612    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg" podUID="4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" containerName="istio-proxy" containerID="cri-o://38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db" gracePeriod=30
Jul 14 16:50:51.933145 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:51.933101    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:52.037682 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:52.037647    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:53.636807 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:53.634929    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:56.666292 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:56.666256    2574 patch_prober.go:28] interesting pod/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 14 16:50:56.666689 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:56.666316    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg" podUID="4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:50:57.179315 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.179247    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:57.299100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299052    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-podinfo\") pod \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") "
Jul 14 16:50:57.299310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299111    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6jrb\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-kube-api-access-g6jrb\") pod \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") "
Jul 14 16:50:57.299310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299147    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-data\") pod \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") "
Jul 14 16:50:57.299310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299176    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-token\") pod \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") "
Jul 14 16:50:57.299310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299205    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-certs\") pod \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") "
Jul 14 16:50:57.299310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299231    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-socket\") pod \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") "
Jul 14 16:50:57.299310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299276    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istiod-ca-cert\") pod \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") "
Jul 14 16:50:57.299310 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299307    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-credential-socket\") pod \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") "
Jul 14 16:50:57.299676 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299414    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-envoy\") pod \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\" (UID: \"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a\") "
Jul 14 16:50:57.299676 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-data" (OuterVolumeSpecName: "istio-data") pod "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" (UID: "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:57.299676 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299550    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" (UID: "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:57.299867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299742    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-data\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:57.299867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299761    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:57.299867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299765    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" (UID: "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:57.300023 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299854    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" (UID: "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:50:57.300023 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.299952    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" (UID: "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:57.301642 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.301619    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-kube-api-access-g6jrb" (OuterVolumeSpecName: "kube-api-access-g6jrb") pod "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" (UID: "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a"). InnerVolumeSpecName "kube-api-access-g6jrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:50:57.301734 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.301666    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" (UID: "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:50:57.302102 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.302080    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-token" (OuterVolumeSpecName: "istio-token") pod "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" (UID: "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:50:57.302162 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.302112    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" (UID: "4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:50:57.401079 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.401045    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-envoy\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:57.401079 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.401072    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-podinfo\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:57.401079 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.401081    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6jrb\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-kube-api-access-g6jrb\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:57.401079 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.401089    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:57.401352 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.401101    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-workload-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:57.401352 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.401110    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-istiod-ca-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:57.401352 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.401118    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a-credential-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:50:57.720889 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.720845    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:57.748104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.748072    2574 generic.go:356] "Generic (PLEG): container finished" podID="4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" containerID="38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db" exitCode=0
Jul 14 16:50:57.748279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.748122    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"
Jul 14 16:50:57.748279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.748142    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg" event={"ID":"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a","Type":"ContainerDied","Data":"38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db"}
Jul 14 16:50:57.748279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.748188    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg" event={"ID":"4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a","Type":"ContainerDied","Data":"f89f66b2c29e145e66401c25d63409c54ec6346a7ab5c91998962775794939b5"}
Jul 14 16:50:57.748279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.748210    2574 scope.go:117] "RemoveContainer" containerID="38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db"
Jul 14 16:50:57.757902 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.757869    2574 scope.go:117] "RemoveContainer" containerID="38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db"
Jul 14 16:50:57.758199 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:50:57.758175    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db\": container with ID starting with 38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db not found: ID does not exist" containerID="38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db"
Jul 14 16:50:57.758254 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.758206    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db"} err="failed to get container status \"38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db\": rpc error: code = NotFound desc = could not find container \"38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db\": container with ID starting with 38895927907b3db36295f768517da02493d67844f9428b87792396c1960c99db not found: ID does not exist"
Jul 14 16:50:57.770234 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.770195    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"]
Jul 14 16:50:57.777986 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.777957    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-236b761c-openshift-default-68df6dbcc9-pw5jg"]
Jul 14 16:50:57.791307 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.791271    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:57.924927 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.924892    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"]
Jul 14 16:50:57.925304 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.925290    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b38229f3-c438-40d5-a0ba-17a973813c61" containerName="maas-api"
Jul 14 16:50:57.925370 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.925306    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b38229f3-c438-40d5-a0ba-17a973813c61" containerName="maas-api"
Jul 14 16:50:57.925370 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.925316    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" containerName="istio-proxy"
Jul 14 16:50:57.925370 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.925323    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" containerName="istio-proxy"
Jul 14 16:50:57.925531 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.925381    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b38229f3-c438-40d5-a0ba-17a973813c61" containerName="maas-api"
Jul 14 16:50:57.925531 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.925391    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" containerName="istio-proxy"
Jul 14 16:50:57.929822 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.929770    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:57.933162 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.933112    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-66f5a621-openshift-default-dockercfg-gwg56\""
Jul 14 16:50:57.955686 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:57.955653    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"]
Jul 14 16:50:58.006363 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.006320    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-certs\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.006556 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.006391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-envoy\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.006556 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.006417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-podinfo\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.006556 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.006440    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-token\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.006556 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.006488    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-socket\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.006556 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.006519    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-credential-socket\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.006556 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.006542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istiod-ca-cert\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.006836 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.006609    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-data\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.006836 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.006671    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qnpr\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-kube-api-access-8qnpr\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.027298 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.027263    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:58.107583 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.107532    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-certs\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.107797 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.107595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-envoy\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.107797 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.107717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-podinfo\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.107797 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.107759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-token\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.107979 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.107825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-socket\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.107979 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.107861    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-credential-socket\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.107979 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.107885    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istiod-ca-cert\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.107979 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.107947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-data\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.108210 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.108012    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qnpr\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-kube-api-access-8qnpr\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.108210 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.108041    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-certs\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.108330 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.108310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-socket\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.108403 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.108384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-credential-socket\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.108576 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.108556    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-data\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.108658 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.108641    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istiod-ca-cert\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.110679 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.110637    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-envoy\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.110872 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.110856    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-podinfo\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.120172 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.120147    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-token\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.124429 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.124405    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qnpr\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-kube-api-access-8qnpr\") pod \"e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") " pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.161275 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.161234    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:58.240495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.240447    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:58.390728 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.390696    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"]
Jul 14 16:50:58.393290 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:50:58.393261    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe1d495_f0c4_4251_a8b5_3df7dc2d07a9.slice/crio-296f38f19fdbccf20c57ebb3dd72918861b16346b300ffe999a8cb28049ea0ea WatchSource:0}: Error finding container 296f38f19fdbccf20c57ebb3dd72918861b16346b300ffe999a8cb28049ea0ea: Status 404 returned error can't find the container with id 296f38f19fdbccf20c57ebb3dd72918861b16346b300ffe999a8cb28049ea0ea
Jul 14 16:50:58.395505 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.395473    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:50:58.395605 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.395559    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:50:58.395670 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.395604    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:50:58.763965 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.758573    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a" path="/var/lib/kubelet/pods/4bc4f6e6-f989-43c3-a6c6-9b1e0f02f82a/volumes"
Jul 14 16:50:58.763965 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.758999    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q" event={"ID":"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9","Type":"ContainerStarted","Data":"52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e"}
Jul 14 16:50:58.763965 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.759062    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q" event={"ID":"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9","Type":"ContainerStarted","Data":"296f38f19fdbccf20c57ebb3dd72918861b16346b300ffe999a8cb28049ea0ea"}
Jul 14 16:50:58.785803 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:58.785731    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q" podStartSLOduration=1.785714951 podStartE2EDuration="1.785714951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:50:58.783187356 +0000 UTC m=+1492.562351292" watchObservedRunningTime="2026-07-14 16:50:58.785714951 +0000 UTC m=+1492.564878886"
Jul 14 16:50:59.183593 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.183488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:59.241395 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.241355    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:59.246405 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.246377    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:59.271135 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.271079    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:59.393479 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.393441    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"]
Jul 14 16:50:59.397869 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.397842    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:50:59.400492 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.400467    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-66f5a621-serving-cert\""
Jul 14 16:50:59.410587 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.410545    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"]
Jul 14 16:50:59.419852 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.419777    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95778044-1243-49d8-bbc1-468e101798ab-maas-api-tls\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:50:59.420057 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.419880    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95778044-1243-49d8-bbc1-468e101798ab-openshift-service-ca\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:50:59.420057 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.419936    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7grj\" (UniqueName: \"kubernetes.io/projected/95778044-1243-49d8-bbc1-468e101798ab-kube-api-access-t7grj\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:50:59.436589 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.436500    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:50:59.521365 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.521316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95778044-1243-49d8-bbc1-468e101798ab-maas-api-tls\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:50:59.521567 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.521372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95778044-1243-49d8-bbc1-468e101798ab-openshift-service-ca\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:50:59.521567 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.521429    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7grj\" (UniqueName: \"kubernetes.io/projected/95778044-1243-49d8-bbc1-468e101798ab-kube-api-access-t7grj\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:50:59.521567 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:50:59.521477    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-66f5a621-serving-cert: secret "maas-api-e2e-derive-66f5a621-serving-cert" not found
Jul 14 16:50:59.521567 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:50:59.521550    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95778044-1243-49d8-bbc1-468e101798ab-maas-api-tls podName:95778044-1243-49d8-bbc1-468e101798ab nodeName:}" failed. No retries permitted until 2026-07-14 16:51:00.02153215 +0000 UTC m=+1493.800696065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/95778044-1243-49d8-bbc1-468e101798ab-maas-api-tls") pod "maas-api-e2e-derive-66f5a621-db494bf65-jxpgn" (UID: "95778044-1243-49d8-bbc1-468e101798ab") : secret "maas-api-e2e-derive-66f5a621-serving-cert" not found
Jul 14 16:50:59.522102 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.522082    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95778044-1243-49d8-bbc1-468e101798ab-openshift-service-ca\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:50:59.533932 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.533892    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7grj\" (UniqueName: \"kubernetes.io/projected/95778044-1243-49d8-bbc1-468e101798ab-kube-api-access-t7grj\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:50:59.763176 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.763134    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:59.764411 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.764388    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:50:59.926131 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:50:59.926059    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:00.026411 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:00.026312    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95778044-1243-49d8-bbc1-468e101798ab-maas-api-tls\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:51:00.027439 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:00.027407    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:00.029146 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:00.029124    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95778044-1243-49d8-bbc1-468e101798ab-maas-api-tls\") pod \"maas-api-e2e-derive-66f5a621-db494bf65-jxpgn\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") " pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:51:00.311067 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:00.310966    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:51:00.453360 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:00.453333    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"]
Jul 14 16:51:00.455160 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:51:00.455122    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95778044_1243_49d8_bbc1_468e101798ab.slice/crio-0b0a9ba2c85c16e987bc31fdaeb3d5d61fd91315bdbf0b955b363bfaabd9ef93 WatchSource:0}: Error finding container 0b0a9ba2c85c16e987bc31fdaeb3d5d61fd91315bdbf0b955b363bfaabd9ef93: Status 404 returned error can't find the container with id 0b0a9ba2c85c16e987bc31fdaeb3d5d61fd91315bdbf0b955b363bfaabd9ef93
Jul 14 16:51:00.769384 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:00.769345    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn" event={"ID":"95778044-1243-49d8-bbc1-468e101798ab","Type":"ContainerStarted","Data":"0b0a9ba2c85c16e987bc31fdaeb3d5d61fd91315bdbf0b955b363bfaabd9ef93"}
Jul 14 16:51:01.215383 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:01.215341    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:01.775574 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:01.775539    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn" event={"ID":"95778044-1243-49d8-bbc1-468e101798ab","Type":"ContainerStarted","Data":"49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f"}
Jul 14 16:51:01.796908 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:01.796851    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn" podStartSLOduration=2.44958108 podStartE2EDuration="2.796830039s" totalImagesPullingTime="347.248959ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:51:01.795011082 +0000 UTC m=+1495.574175017" watchObservedRunningTime="2026-07-14 16:51:01.796830039 +0000 UTC m=+1495.575993974"
Jul 14 16:51:02.779993 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:02.779950    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:51:03.649760 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:03.649711    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:03.808965 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:03.808930    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"]
Jul 14 16:51:03.809403 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:03.809129    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q" podUID="5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" containerName="istio-proxy" containerID="cri-o://52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e" gracePeriod=30
Jul 14 16:51:03.879902 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:03.879865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:03.978338 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:03.978238    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"]
Jul 14 16:51:03.983353 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:03.983317    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:04.062118 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:04.062084    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:04.788984 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:04.788940    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn" podUID="95778044-1243-49d8-bbc1-468e101798ab" containerName="maas-api" containerID="cri-o://49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f" gracePeriod=30
Jul 14 16:51:05.049227 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.049158    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:51:05.078154 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.078120    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95778044-1243-49d8-bbc1-468e101798ab-openshift-service-ca\") pod \"95778044-1243-49d8-bbc1-468e101798ab\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") "
Jul 14 16:51:05.078154 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.078157    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7grj\" (UniqueName: \"kubernetes.io/projected/95778044-1243-49d8-bbc1-468e101798ab-kube-api-access-t7grj\") pod \"95778044-1243-49d8-bbc1-468e101798ab\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") "
Jul 14 16:51:05.078411 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.078176    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95778044-1243-49d8-bbc1-468e101798ab-maas-api-tls\") pod \"95778044-1243-49d8-bbc1-468e101798ab\" (UID: \"95778044-1243-49d8-bbc1-468e101798ab\") "
Jul 14 16:51:05.078539 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.078516    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95778044-1243-49d8-bbc1-468e101798ab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95778044-1243-49d8-bbc1-468e101798ab" (UID: "95778044-1243-49d8-bbc1-468e101798ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:51:05.080508 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.080479    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95778044-1243-49d8-bbc1-468e101798ab-kube-api-access-t7grj" (OuterVolumeSpecName: "kube-api-access-t7grj") pod "95778044-1243-49d8-bbc1-468e101798ab" (UID: "95778044-1243-49d8-bbc1-468e101798ab"). InnerVolumeSpecName "kube-api-access-t7grj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:51:05.080620 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.080478    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95778044-1243-49d8-bbc1-468e101798ab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95778044-1243-49d8-bbc1-468e101798ab" (UID: "95778044-1243-49d8-bbc1-468e101798ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:51:05.179476 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.179440    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95778044-1243-49d8-bbc1-468e101798ab-openshift-service-ca\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:05.179476 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.179471    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7grj\" (UniqueName: \"kubernetes.io/projected/95778044-1243-49d8-bbc1-468e101798ab-kube-api-access-t7grj\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:05.179476 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.179482    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95778044-1243-49d8-bbc1-468e101798ab-maas-api-tls\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:05.794991 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.794950    2574 generic.go:356] "Generic (PLEG): container finished" podID="95778044-1243-49d8-bbc1-468e101798ab" containerID="49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f" exitCode=0
Jul 14 16:51:05.795168 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.794999    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"
Jul 14 16:51:05.795168 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.795012    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn" event={"ID":"95778044-1243-49d8-bbc1-468e101798ab","Type":"ContainerDied","Data":"49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f"}
Jul 14 16:51:05.795168 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.795069    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn" event={"ID":"95778044-1243-49d8-bbc1-468e101798ab","Type":"ContainerDied","Data":"0b0a9ba2c85c16e987bc31fdaeb3d5d61fd91315bdbf0b955b363bfaabd9ef93"}
Jul 14 16:51:05.795168 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.795098    2574 scope.go:117] "RemoveContainer" containerID="49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f"
Jul 14 16:51:05.804626 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.804603    2574 scope.go:117] "RemoveContainer" containerID="49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f"
Jul 14 16:51:05.804942 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:51:05.804923    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f\": container with ID starting with 49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f not found: ID does not exist" containerID="49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f"
Jul 14 16:51:05.804998 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.804952    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f"} err="failed to get container status \"49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f\": rpc error: code = NotFound desc = could not find container \"49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f\": container with ID starting with 49b8a408a6024bc0aac9745b0eec22235609d9530567f78e8d78eb2d3ca2628f not found: ID does not exist"
Jul 14 16:51:05.826499 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.826459    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"]
Jul 14 16:51:05.831458 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:05.831404    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-66f5a621-db494bf65-jxpgn"]
Jul 14 16:51:06.726141 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:06.726011    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:51:06.749116 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:06.728545    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:51:06.762745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:06.758533    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95778044-1243-49d8-bbc1-468e101798ab" path="/var/lib/kubelet/pods/95778044-1243-49d8-bbc1-468e101798ab/volumes"
Jul 14 16:51:07.902252 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:07.902204    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:09.065914 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.065877    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:51:09.116870 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.116755    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-socket\") pod \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") "
Jul 14 16:51:09.116870 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.116803    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-data\") pod \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") "
Jul 14 16:51:09.116870 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.116847    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-credential-socket\") pod \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") "
Jul 14 16:51:09.116870 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.116873    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-certs\") pod \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") "
Jul 14 16:51:09.117215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.116894    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qnpr\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-kube-api-access-8qnpr\") pod \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") "
Jul 14 16:51:09.117215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.116921    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-token\") pod \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") "
Jul 14 16:51:09.117215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.116943    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istiod-ca-cert\") pod \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") "
Jul 14 16:51:09.117215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117019    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-podinfo\") pod \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") "
Jul 14 16:51:09.117215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117077    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-envoy\") pod \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\" (UID: \"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9\") "
Jul 14 16:51:09.117215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117099    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" (UID: "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:51:09.117215 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117209    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" (UID: "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:51:09.117557 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117222    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" (UID: "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:51:09.117557 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117394    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:09.117557 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117418    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-credential-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:09.117557 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117432    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-workload-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:09.117557 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117430    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" (UID: "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:51:09.117557 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.117463    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" (UID: "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:51:09.119486 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.119459    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-kube-api-access-8qnpr" (OuterVolumeSpecName: "kube-api-access-8qnpr") pod "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" (UID: "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9"). InnerVolumeSpecName "kube-api-access-8qnpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:51:09.119630 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.119514    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" (UID: "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:51:09.119875 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.119851    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" (UID: "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:51:09.119979 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.119892    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" (UID: "5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:51:09.218440 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.218395    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-envoy\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:09.218440 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.218432    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-data\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:09.218440 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.218442    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qnpr\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-kube-api-access-8qnpr\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:09.218440 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.218451    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:09.218723 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.218459    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istiod-ca-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:09.218723 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.218466    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9-istio-podinfo\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:51:09.817186 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.817153    2574 generic.go:356] "Generic (PLEG): container finished" podID="5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" containerID="52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e" exitCode=0
Jul 14 16:51:09.817381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.817200    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"
Jul 14 16:51:09.817381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.817239    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q" event={"ID":"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9","Type":"ContainerDied","Data":"52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e"}
Jul 14 16:51:09.817381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.817300    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q" event={"ID":"5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9","Type":"ContainerDied","Data":"296f38f19fdbccf20c57ebb3dd72918861b16346b300ffe999a8cb28049ea0ea"}
Jul 14 16:51:09.817381 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.817331    2574 scope.go:117] "RemoveContainer" containerID="52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e"
Jul 14 16:51:09.827290 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.827268    2574 scope.go:117] "RemoveContainer" containerID="52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e"
Jul 14 16:51:09.827624 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:51:09.827593    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e\": container with ID starting with 52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e not found: ID does not exist" containerID="52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e"
Jul 14 16:51:09.827688 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.827635    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e"} err="failed to get container status \"52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e\": rpc error: code = NotFound desc = could not find container \"52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e\": container with ID starting with 52628354ac3797d7714de3f3ebc12a96e813abd6c1cd3afe97866f8d85b3133e not found: ID does not exist"
Jul 14 16:51:09.840627 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.840590    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"]
Jul 14 16:51:09.848400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.848368    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-66f5a621-openshift-default-7dc84cd655-llm8q"]
Jul 14 16:51:09.946758 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:09.946711    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:10.046900 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:10.046867    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:10.449869 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:10.449824    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:10.550610 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:10.550545    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:10.649591 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:10.649557    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:10.756279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:10.756248    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" path="/var/lib/kubelet/pods/5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9/volumes"
Jul 14 16:51:12.073004 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:12.072943    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:18.192774 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:18.192735    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:18.256281 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:18.256240    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:18.362433 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:18.362396    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:18.462456 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:18.462352    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:18.935189 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:18.935149    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:44.952255 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:44.952212    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:50.735046 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:50.735005    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:50.841616 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:50.841576    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:50.934118 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:50.934063    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:51:56.227119 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:51:56.227083    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:06.907406 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:06.907370    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:12.757058 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:12.757022    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:12.862615 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:12.862573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:12.967642 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:12.967597    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:23.539394 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:23.539356    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:24.531477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:24.531441    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:30.379083 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:30.379044    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:30.483580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:30.483530    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:30.575773 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:30.575731    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:30.675774 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:30.675668    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:31.572296 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:31.572261    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:31.671050 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:31.671008    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:31.771123 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:31.771091    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:33.579226 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:33.579188    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:35.191502 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:35.191465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:39.920433 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:39.920388    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:40.029463 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:40.029429    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:40.645581 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:40.645546    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:46.753437 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:46.753403    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:46.852153 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:46.852121    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:47.181171 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.181075    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:47.635930 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.635895    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"]
Jul 14 16:52:47.636449 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.636433    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95778044-1243-49d8-bbc1-468e101798ab" containerName="maas-api"
Jul 14 16:52:47.636517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.636451    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="95778044-1243-49d8-bbc1-468e101798ab" containerName="maas-api"
Jul 14 16:52:47.636517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.636467    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" containerName="istio-proxy"
Jul 14 16:52:47.636517 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.636475    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" containerName="istio-proxy"
Jul 14 16:52:47.636611 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.636567    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe1d495-f0c4-4251-a8b5-3df7dc2d07a9" containerName="istio-proxy"
Jul 14 16:52:47.636611 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.636580    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="95778044-1243-49d8-bbc1-468e101798ab" containerName="maas-api"
Jul 14 16:52:47.639886 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.639863    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.648715 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.648686    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fa2710e5-openshift-default-dockercfg-df88h\""
Jul 14 16:52:47.651379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.651346    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:47.672198 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.672160    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"]
Jul 14 16:52:47.709035 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.708983    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-994zl\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-kube-api-access-994zl\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.709035 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.709038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-certs\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.709306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.709068    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-token\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.709306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.709097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c7ed89-fa76-4d67-8089-5ca889701cab-istiod-ca-cert\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.709306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.709128    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-socket\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.709306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.709149    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-podinfo\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.709306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.709177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-envoy\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.709306 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.709276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-data\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.709547 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.709341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-credential-socket\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.810877 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.810839    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-994zl\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-kube-api-access-994zl\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.810877 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.810882    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-certs\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.810902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-token\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.810923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c7ed89-fa76-4d67-8089-5ca889701cab-istiod-ca-cert\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811051    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-socket\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811097    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-podinfo\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811131    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-envoy\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811220    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-data\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811291    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-credential-socket\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811317    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-certs\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811366    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-socket\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811882 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811630    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-data\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811882 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811682    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c7ed89-fa76-4d67-8089-5ca889701cab-istiod-ca-cert\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.811882 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.811695    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-credential-socket\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.813593 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.813569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-envoy\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.813703 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.813688    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-podinfo\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.829211 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.829182    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-token\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.830932 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.830906    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-994zl\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-kube-api-access-994zl\") pod \"e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") " pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:47.921242 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.921145    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:47.954279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:47.954225    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:48.133586 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:48.133555    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"]
Jul 14 16:52:48.139323 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:48.139279    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:52:48.139450 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:48.139367    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:52:48.139450 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:48.139413    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:52:48.292463 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:48.292417    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" event={"ID":"19c7ed89-fa76-4d67-8089-5ca889701cab","Type":"ContainerStarted","Data":"38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56"}
Jul 14 16:52:48.292651 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:48.292486    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" event={"ID":"19c7ed89-fa76-4d67-8089-5ca889701cab","Type":"ContainerStarted","Data":"6334f74a4d6d542b64d2bcc9da868cf964860a877730273d010e6892915a4f8f"}
Jul 14 16:52:48.332611 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:48.332546    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" podStartSLOduration=1.332527523 podStartE2EDuration="1.332527523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:52:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:52:48.321010887 +0000 UTC m=+1602.100174828" watchObservedRunningTime="2026-07-14 16:52:48.332527523 +0000 UTC m=+1602.111691458"
Jul 14 16:52:48.955000 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:48.954942    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:49.960538 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:49.960502    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:50.303436 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:50.303403    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:50.304437 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:50.304418    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:52:50.838309 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:50.838274    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:50.918863 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:50.918821    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"]
Jul 14 16:52:50.922492 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:50.922466    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:50.925187 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:50.925158    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-fa2710e5-serving-cert\""
Jul 14 16:52:50.939039 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:50.939005    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"]
Jul 14 16:52:50.947427 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:50.947395    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:51.043428 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.043396    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabb1a35-d142-43f8-adff-53888d0ce1b5-openshift-service-ca\") pod \"maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") " pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.043880 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.043441    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h4fq\" (UniqueName: \"kubernetes.io/projected/cabb1a35-d142-43f8-adff-53888d0ce1b5-kube-api-access-9h4fq\") pod \"maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") " pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.043880 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.043553    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabb1a35-d142-43f8-adff-53888d0ce1b5-maas-api-tls\") pod \"maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") " pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.144498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.144403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabb1a35-d142-43f8-adff-53888d0ce1b5-maas-api-tls\") pod \"maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") " pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.144668 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.144495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabb1a35-d142-43f8-adff-53888d0ce1b5-openshift-service-ca\") pod \"maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") " pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.144668 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.144539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h4fq\" (UniqueName: \"kubernetes.io/projected/cabb1a35-d142-43f8-adff-53888d0ce1b5-kube-api-access-9h4fq\") pod \"maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") " pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.145271 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.145250    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabb1a35-d142-43f8-adff-53888d0ce1b5-openshift-service-ca\") pod \"maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") " pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.147174 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.147153    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabb1a35-d142-43f8-adff-53888d0ce1b5-maas-api-tls\") pod \"maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") " pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.154891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.154862    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h4fq\" (UniqueName: \"kubernetes.io/projected/cabb1a35-d142-43f8-adff-53888d0ce1b5-kube-api-access-9h4fq\") pod \"maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") " pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.234630 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.234586    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:51.401294 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.401260    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"]
Jul 14 16:52:51.402621 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:52:51.402596    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabb1a35_d142_43f8_adff_53888d0ce1b5.slice/crio-13e4f94e10f41c1b5ddeda0db7f9ccaa68f44185dcc342497f25e92b6556e3f9 WatchSource:0}: Error finding container 13e4f94e10f41c1b5ddeda0db7f9ccaa68f44185dcc342497f25e92b6556e3f9: Status 404 returned error can't find the container with id 13e4f94e10f41c1b5ddeda0db7f9ccaa68f44185dcc342497f25e92b6556e3f9
Jul 14 16:52:51.813736 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.813699    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:51.907580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:51.907538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:52.315609 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:52.315568    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl" event={"ID":"cabb1a35-d142-43f8-adff-53888d0ce1b5","Type":"ContainerStarted","Data":"4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190"}
Jul 14 16:52:52.316241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:52.315634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl" event={"ID":"cabb1a35-d142-43f8-adff-53888d0ce1b5","Type":"ContainerStarted","Data":"13e4f94e10f41c1b5ddeda0db7f9ccaa68f44185dcc342497f25e92b6556e3f9"}
Jul 14 16:52:52.338009 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:52.337953    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl" podStartSLOduration=1.9159329779999998 podStartE2EDuration="2.337934152s" totalImagesPullingTime="422.001174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:52:52.336172799 +0000 UTC m=+1606.115336735" watchObservedRunningTime="2026-07-14 16:52:52.337934152 +0000 UTC m=+1606.117098102"
Jul 14 16:52:53.320434 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:53.320405    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:52:55.294265 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:55.294227    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:56.026628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:56.026596    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:56.114162 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:56.114121    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:56.559794 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:56.559756    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:52:59.330603 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:52:59.330569    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:53:03.224290 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:03.224197    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:03.368466 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:03.368364    2574 generic.go:356] "Generic (PLEG): container finished" podID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerID="38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56" exitCode=0
Jul 14 16:53:03.368466 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:03.368440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" event={"ID":"19c7ed89-fa76-4d67-8089-5ca889701cab","Type":"ContainerDied","Data":"38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56"}
Jul 14 16:53:03.368900 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:03.368882    2574 scope.go:117] "RemoveContainer" containerID="38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56"
Jul 14 16:53:03.369985 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:03.369959    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:53:03.370059 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:03.370033    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:53:03.370113 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:03.370067    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:53:03.385479 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:03.385434    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:03.783275 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:03.783242    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:04.225711 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.225613    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:04.380118 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.380082    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" event={"ID":"19c7ed89-fa76-4d67-8089-5ca889701cab","Type":"ContainerStarted","Data":"a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64"}
Jul 14 16:53:04.575882 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.575840    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"]
Jul 14 16:53:04.576133 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.576102    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl" podUID="cabb1a35-d142-43f8-adff-53888d0ce1b5" containerName="maas-api" containerID="cri-o://4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190" gracePeriod=30
Jul 14 16:53:04.792811 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.791334    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:04.857036 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.857010    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:53:04.954928 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.954889    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:53:04.956046 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.956026    2574 patch_prober.go:28] interesting pod/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 14 16:53:04.956106 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.956079    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 14 16:53:04.999426 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.999389    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabb1a35-d142-43f8-adff-53888d0ce1b5-openshift-service-ca\") pod \"cabb1a35-d142-43f8-adff-53888d0ce1b5\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") "
Jul 14 16:53:04.999607 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.999437    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h4fq\" (UniqueName: \"kubernetes.io/projected/cabb1a35-d142-43f8-adff-53888d0ce1b5-kube-api-access-9h4fq\") pod \"cabb1a35-d142-43f8-adff-53888d0ce1b5\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") "
Jul 14 16:53:04.999607 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.999527    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabb1a35-d142-43f8-adff-53888d0ce1b5-maas-api-tls\") pod \"cabb1a35-d142-43f8-adff-53888d0ce1b5\" (UID: \"cabb1a35-d142-43f8-adff-53888d0ce1b5\") "
Jul 14 16:53:04.999864 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:04.999831    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cabb1a35-d142-43f8-adff-53888d0ce1b5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cabb1a35-d142-43f8-adff-53888d0ce1b5" (UID: "cabb1a35-d142-43f8-adff-53888d0ce1b5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:53:05.001818 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.001769    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cabb1a35-d142-43f8-adff-53888d0ce1b5-kube-api-access-9h4fq" (OuterVolumeSpecName: "kube-api-access-9h4fq") pod "cabb1a35-d142-43f8-adff-53888d0ce1b5" (UID: "cabb1a35-d142-43f8-adff-53888d0ce1b5"). InnerVolumeSpecName "kube-api-access-9h4fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:53:05.001931 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.001848    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cabb1a35-d142-43f8-adff-53888d0ce1b5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cabb1a35-d142-43f8-adff-53888d0ce1b5" (UID: "cabb1a35-d142-43f8-adff-53888d0ce1b5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:53:05.100400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.100304    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabb1a35-d142-43f8-adff-53888d0ce1b5-openshift-service-ca\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:05.100400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.100337    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h4fq\" (UniqueName: \"kubernetes.io/projected/cabb1a35-d142-43f8-adff-53888d0ce1b5-kube-api-access-9h4fq\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:05.100400 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.100347    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabb1a35-d142-43f8-adff-53888d0ce1b5-maas-api-tls\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:05.303991 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.303955    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:53:05.389574 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.389462    2574 generic.go:356] "Generic (PLEG): container finished" podID="cabb1a35-d142-43f8-adff-53888d0ce1b5" containerID="4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190" exitCode=0
Jul 14 16:53:05.390412 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.390381    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"
Jul 14 16:53:05.393148 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.393109    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl" event={"ID":"cabb1a35-d142-43f8-adff-53888d0ce1b5","Type":"ContainerDied","Data":"4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190"}
Jul 14 16:53:05.393285 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.393183    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl" event={"ID":"cabb1a35-d142-43f8-adff-53888d0ce1b5","Type":"ContainerDied","Data":"13e4f94e10f41c1b5ddeda0db7f9ccaa68f44185dcc342497f25e92b6556e3f9"}
Jul 14 16:53:05.393285 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.393214    2574 scope.go:117] "RemoveContainer" containerID="4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190"
Jul 14 16:53:05.405938 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.405916    2574 scope.go:117] "RemoveContainer" containerID="4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190"
Jul 14 16:53:05.406281 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:53:05.406261    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190\": container with ID starting with 4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190 not found: ID does not exist" containerID="4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190"
Jul 14 16:53:05.406354 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.406294    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190"} err="failed to get container status \"4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190\": rpc error: code = NotFound desc = could not find container \"4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190\": container with ID starting with 4777157a028cc2f5aba88fca785060acf035f2058b22fb1d46474a2556e99190 not found: ID does not exist"
Jul 14 16:53:05.428075 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.428039    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"]
Jul 14 16:53:05.432233 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.432199    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-fa2710e5-7475d7646f-6q6jl"]
Jul 14 16:53:05.955641 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.955600    2574 patch_prober.go:28] interesting pod/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 14 16:53:05.955850 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:05.955661    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 14 16:53:06.756841 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:06.756804    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cabb1a35-d142-43f8-adff-53888d0ce1b5" path="/var/lib/kubelet/pods/cabb1a35-d142-43f8-adff-53888d0ce1b5/volumes"
Jul 14 16:53:06.955394 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:06.955358    2574 patch_prober.go:28] interesting pod/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 14 16:53:06.955569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:06.955415    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 14 16:53:07.954979 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:07.954939    2574 patch_prober.go:28] interesting pod/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 14 16:53:07.955394 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:07.955003    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 14 16:53:08.958994 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:08.958953    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:53:08.960136 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:08.960112    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:53:10.575935 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:10.575897    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:10.647593 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:10.647551    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:10.832237 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:10.832144    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"]
Jul 14 16:53:10.832384 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:10.832345    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy" containerID="cri-o://a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64" gracePeriod=30
Jul 14 16:53:11.194916 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:11.194801    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:11.400330 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:11.400284    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:11.557415 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:11.557375    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:11.681641 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:11.681595    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:16.085426 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.085396    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:53:16.199749 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.199654    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-994zl\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-kube-api-access-994zl\") pod \"19c7ed89-fa76-4d67-8089-5ca889701cab\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") "
Jul 14 16:53:16.199749 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.199702    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-certs\") pod \"19c7ed89-fa76-4d67-8089-5ca889701cab\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") "
Jul 14 16:53:16.199749 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.199734    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-podinfo\") pod \"19c7ed89-fa76-4d67-8089-5ca889701cab\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") "
Jul 14 16:53:16.200104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.199762    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-socket\") pod \"19c7ed89-fa76-4d67-8089-5ca889701cab\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") "
Jul 14 16:53:16.200104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.199818    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-token\") pod \"19c7ed89-fa76-4d67-8089-5ca889701cab\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") "
Jul 14 16:53:16.200104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.199953    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-credential-socket\") pod \"19c7ed89-fa76-4d67-8089-5ca889701cab\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") "
Jul 14 16:53:16.200104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200002    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-data\") pod \"19c7ed89-fa76-4d67-8089-5ca889701cab\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") "
Jul 14 16:53:16.200104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200054    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-envoy\") pod \"19c7ed89-fa76-4d67-8089-5ca889701cab\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") "
Jul 14 16:53:16.200104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200043    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19c7ed89-fa76-4d67-8089-5ca889701cab" (UID: "19c7ed89-fa76-4d67-8089-5ca889701cab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:53:16.200562 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200125    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c7ed89-fa76-4d67-8089-5ca889701cab-istiod-ca-cert\") pod \"19c7ed89-fa76-4d67-8089-5ca889701cab\" (UID: \"19c7ed89-fa76-4d67-8089-5ca889701cab\") "
Jul 14 16:53:16.200562 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200128    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19c7ed89-fa76-4d67-8089-5ca889701cab" (UID: "19c7ed89-fa76-4d67-8089-5ca889701cab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:53:16.200562 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200238    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19c7ed89-fa76-4d67-8089-5ca889701cab" (UID: "19c7ed89-fa76-4d67-8089-5ca889701cab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:53:16.200562 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200427    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-credential-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:16.200562 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200446    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:16.200562 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200460    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-workload-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:16.200562 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.200503    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c7ed89-fa76-4d67-8089-5ca889701cab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19c7ed89-fa76-4d67-8089-5ca889701cab" (UID: "19c7ed89-fa76-4d67-8089-5ca889701cab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:53:16.201211 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.201181    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-data" (OuterVolumeSpecName: "istio-data") pod "19c7ed89-fa76-4d67-8089-5ca889701cab" (UID: "19c7ed89-fa76-4d67-8089-5ca889701cab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:53:16.202263 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.202235    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-token" (OuterVolumeSpecName: "istio-token") pod "19c7ed89-fa76-4d67-8089-5ca889701cab" (UID: "19c7ed89-fa76-4d67-8089-5ca889701cab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:53:16.202263 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.202254    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19c7ed89-fa76-4d67-8089-5ca889701cab" (UID: "19c7ed89-fa76-4d67-8089-5ca889701cab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:53:16.202399 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.202306    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-kube-api-access-994zl" (OuterVolumeSpecName: "kube-api-access-994zl") pod "19c7ed89-fa76-4d67-8089-5ca889701cab" (UID: "19c7ed89-fa76-4d67-8089-5ca889701cab"). InnerVolumeSpecName "kube-api-access-994zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:53:16.202447 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.202428    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19c7ed89-fa76-4d67-8089-5ca889701cab" (UID: "19c7ed89-fa76-4d67-8089-5ca889701cab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:53:16.301480 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.301448    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-podinfo\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:16.301480 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.301477    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:16.301480 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.301486    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-data\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:16.301702 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.301493    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c7ed89-fa76-4d67-8089-5ca889701cab-istio-envoy\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:16.301702 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.301503    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c7ed89-fa76-4d67-8089-5ca889701cab-istiod-ca-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:16.301702 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.301517    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-994zl\" (UniqueName: \"kubernetes.io/projected/19c7ed89-fa76-4d67-8089-5ca889701cab-kube-api-access-994zl\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:53:16.449492 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.449444    2574 generic.go:356] "Generic (PLEG): container finished" podID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerID="a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64" exitCode=0
Jul 14 16:53:16.449492 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.449497    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"
Jul 14 16:53:16.449830 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.449531    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" event={"ID":"19c7ed89-fa76-4d67-8089-5ca889701cab","Type":"ContainerDied","Data":"a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64"}
Jul 14 16:53:16.449830 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.449585    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb" event={"ID":"19c7ed89-fa76-4d67-8089-5ca889701cab","Type":"ContainerDied","Data":"6334f74a4d6d542b64d2bcc9da868cf964860a877730273d010e6892915a4f8f"}
Jul 14 16:53:16.449830 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.449607    2574 scope.go:117] "RemoveContainer" containerID="a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64"
Jul 14 16:53:16.459186 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.459165    2574 scope.go:117] "RemoveContainer" containerID="38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56"
Jul 14 16:53:16.467887 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.467865    2574 scope.go:117] "RemoveContainer" containerID="a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64"
Jul 14 16:53:16.468193 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:53:16.468174    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64\": container with ID starting with a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64 not found: ID does not exist" containerID="a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64"
Jul 14 16:53:16.468245 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.468204    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64"} err="failed to get container status \"a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64\": rpc error: code = NotFound desc = could not find container \"a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64\": container with ID starting with a88e78647aacbcd74f0003fabf8638680ccbc65bee31387e2f5193ef3c53ee64 not found: ID does not exist"
Jul 14 16:53:16.468245 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.468224    2574 scope.go:117] "RemoveContainer" containerID="38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56"
Jul 14 16:53:16.468480 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:53:16.468463    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56\": container with ID starting with 38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56 not found: ID does not exist" containerID="38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56"
Jul 14 16:53:16.468523 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.468484    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56"} err="failed to get container status \"38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56\": rpc error: code = NotFound desc = could not find container \"38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56\": container with ID starting with 38e795f323d24fbad68362c25185a1419d90a89c5016da7a5e88543ae4bf5c56 not found: ID does not exist"
Jul 14 16:53:16.473079 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.473047    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"]
Jul 14 16:53:16.479608 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.479579    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fa2710e5-openshift-default-79fc76949f-vdqsb"]
Jul 14 16:53:16.756619 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:16.756582    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" path="/var/lib/kubelet/pods/19c7ed89-fa76-4d67-8089-5ca889701cab/volumes"
Jul 14 16:53:18.840914 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:18.840867    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:19.107198 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:19.107112    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:19.242009 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:19.241977    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:19.458399 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:19.458301    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:22.211225 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:22.211174    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:22.317845 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:22.317800    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:26.082281 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:26.082238    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:26.160065 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:26.160022    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:33.141891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.141850    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:33.427693 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.427599    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"]
Jul 14 16:53:33.428053 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.428037    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy"
Jul 14 16:53:33.428119 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.428055    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy"
Jul 14 16:53:33.428119 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.428073    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy"
Jul 14 16:53:33.428119 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.428082    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy"
Jul 14 16:53:33.428119 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.428098    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabb1a35-d142-43f8-adff-53888d0ce1b5" containerName="maas-api"
Jul 14 16:53:33.428119 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.428104    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabb1a35-d142-43f8-adff-53888d0ce1b5" containerName="maas-api"
Jul 14 16:53:33.428368 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.428167    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy"
Jul 14 16:53:33.428368 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.428177    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c7ed89-fa76-4d67-8089-5ca889701cab" containerName="istio-proxy"
Jul 14 16:53:33.428368 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.428183    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cabb1a35-d142-43f8-adff-53888d0ce1b5" containerName="maas-api"
Jul 14 16:53:33.431281 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.431255    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.434262 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.434194    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c316bd01-openshift-default-dockercfg-9jv6r\""
Jul 14 16:53:33.447054 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.447012    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"]
Jul 14 16:53:33.457724 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.457689    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:33.560308 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.560249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff69300-eca6-4cb9-a920-1f022007ff40-istiod-ca-cert\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.560495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.560381    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzt2v\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-kube-api-access-mzt2v\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.560495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.560479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-token\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.560592 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.560571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-socket\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.560630 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.560598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-envoy\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.560674 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.560631    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-data\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.560724 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.560695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-certs\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.560761 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.560727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-podinfo\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.560832 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.560757    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-credential-socket\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.654645 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.654597    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:33.661661 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.661633    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-token\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.661774 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.661710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-socket\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.661774 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.661731    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-envoy\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.661774 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.661749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-data\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.661774 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.661770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-certs\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.662001 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.661810    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-podinfo\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.662001 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.661836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-credential-socket\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.662001 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.661879    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff69300-eca6-4cb9-a920-1f022007ff40-istiod-ca-cert\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.662001 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.661935    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzt2v\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-kube-api-access-mzt2v\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.662339 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.662277    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-data\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.662454 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.662398    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-credential-socket\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.662621 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.662594    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-socket\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.662621 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.662612    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-certs\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.663043 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.663017    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff69300-eca6-4cb9-a920-1f022007ff40-istiod-ca-cert\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.664648 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.664629    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-envoy\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.665034 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.665001    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-podinfo\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.673822 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.673761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-token\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.674831 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.674807    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzt2v\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-kube-api-access-mzt2v\") pod \"e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") " pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.745881 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.745765    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:33.960846 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:53:33.960818    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff69300_eca6_4cb9_a920_1f022007ff40.slice/crio-7cb944066fbfbaf8dc56e257c3c1d202be5d93a5c508fc4fa10854aa52ebd4ff WatchSource:0}: Error finding container 7cb944066fbfbaf8dc56e257c3c1d202be5d93a5c508fc4fa10854aa52ebd4ff: Status 404 returned error can't find the container with id 7cb944066fbfbaf8dc56e257c3c1d202be5d93a5c508fc4fa10854aa52ebd4ff
Jul 14 16:53:33.960955 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.960857    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"]
Jul 14 16:53:33.963132 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.963098    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:53:33.963214 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.963179    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:53:33.963251 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:33.963224    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:53:34.538259 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:34.538218    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" event={"ID":"9ff69300-eca6-4cb9-a920-1f022007ff40","Type":"ContainerStarted","Data":"96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26"}
Jul 14 16:53:34.538648 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:34.538283    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" event={"ID":"9ff69300-eca6-4cb9-a920-1f022007ff40","Type":"ContainerStarted","Data":"7cb944066fbfbaf8dc56e257c3c1d202be5d93a5c508fc4fa10854aa52ebd4ff"}
Jul 14 16:53:34.566953 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:34.566893    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" podStartSLOduration=1.5668722019999999 podStartE2EDuration="1.566872202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:53:34.564324914 +0000 UTC m=+1648.343488851" watchObservedRunningTime="2026-07-14 16:53:34.566872202 +0000 UTC m=+1648.346036137"
Jul 14 16:53:34.746395 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:34.746354    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:35.752257 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:35.752225    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:36.548751 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.548714    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:36.549763 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.549735    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:36.682202 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.682166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:36.749342 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.749306    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"]
Jul 14 16:53:36.754016 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.753989    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:36.756720 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.756687    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-c316bd01-serving-cert\""
Jul 14 16:53:36.766135 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.766103    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"]
Jul 14 16:53:36.773430 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.773383    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:36.893683 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.893582    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32a74af7-6534-4986-b937-86902100837b-maas-api-tls\") pod \"maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") " pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:36.893683 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.893655    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdhlh\" (UniqueName: \"kubernetes.io/projected/32a74af7-6534-4986-b937-86902100837b-kube-api-access-jdhlh\") pod \"maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") " pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:36.893908 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.893698    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a74af7-6534-4986-b937-86902100837b-openshift-service-ca\") pod \"maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") " pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:36.994841 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.994766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a74af7-6534-4986-b937-86902100837b-openshift-service-ca\") pod \"maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") " pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:36.995029 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.994884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32a74af7-6534-4986-b937-86902100837b-maas-api-tls\") pod \"maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") " pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:36.995029 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.994945    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdhlh\" (UniqueName: \"kubernetes.io/projected/32a74af7-6534-4986-b937-86902100837b-kube-api-access-jdhlh\") pod \"maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") " pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:36.995496 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.995474    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a74af7-6534-4986-b937-86902100837b-openshift-service-ca\") pod \"maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") " pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:36.997547 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:36.997523    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32a74af7-6534-4986-b937-86902100837b-maas-api-tls\") pod \"maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") " pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:37.018209 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:37.018177    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdhlh\" (UniqueName: \"kubernetes.io/projected/32a74af7-6534-4986-b937-86902100837b-kube-api-access-jdhlh\") pod \"maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") " pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:37.068514 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:37.068471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:37.090395 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:37.090359    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:37.189096 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:37.189063    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:37.219745 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:37.219709    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"]
Jul 14 16:53:37.223363 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:53:37.223327    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a74af7_6534_4986_b937_86902100837b.slice/crio-c9531d465da900fbeba3f464cf19777aa01de7aba6095b2253756861e3b5a5c5 WatchSource:0}: Error finding container c9531d465da900fbeba3f464cf19777aa01de7aba6095b2253756861e3b5a5c5: Status 404 returned error can't find the container with id c9531d465da900fbeba3f464cf19777aa01de7aba6095b2253756861e3b5a5c5
Jul 14 16:53:37.475297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:37.475204    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:37.555116 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:37.555088    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72" event={"ID":"32a74af7-6534-4986-b937-86902100837b","Type":"ContainerStarted","Data":"c9531d465da900fbeba3f464cf19777aa01de7aba6095b2253756861e3b5a5c5"}
Jul 14 16:53:37.569193 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:37.569164    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:38.561936 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:38.561900    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72" event={"ID":"32a74af7-6534-4986-b937-86902100837b","Type":"ContainerStarted","Data":"eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8"}
Jul 14 16:53:38.562416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:38.562216    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:38.582868 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:38.582816    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72" podStartSLOduration=2.25271488 podStartE2EDuration="2.582799045s" totalImagesPullingTime="330.084165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:53:38.581869974 +0000 UTC m=+1652.361033955" watchObservedRunningTime="2026-07-14 16:53:38.582799045 +0000 UTC m=+1652.361962972"
Jul 14 16:53:38.899670 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:38.899567    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:39.001550 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:39.001511    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:41.202274 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:41.202229    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:44.577928 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:44.577886    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:53:47.929776 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:47.929731    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:49.544288 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:49.544252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:49.629013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:49.628981    2574 generic.go:356] "Generic (PLEG): container finished" podID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerID="96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26" exitCode=0
Jul 14 16:53:49.629191 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:49.629060    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" event={"ID":"9ff69300-eca6-4cb9-a920-1f022007ff40","Type":"ContainerDied","Data":"96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26"}
Jul 14 16:53:49.629499 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:49.629485    2574 scope.go:117] "RemoveContainer" containerID="96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26"
Jul 14 16:53:49.630510 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:49.630483    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:53:49.630593 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:49.630553    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:53:49.630593 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:49.630589    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:53:50.635551 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:50.635517    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" event={"ID":"9ff69300-eca6-4cb9-a920-1f022007ff40","Type":"ContainerStarted","Data":"6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40"}
Jul 14 16:53:50.746152 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:50.746105    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:50.747314 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:50.747285    2574 patch_prober.go:28] interesting pod/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 14 16:53:50.747434 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:50.747337    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 14 16:53:51.549583 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:51.549525    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:51.746598 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:51.746563    2574 patch_prober.go:28] interesting pod/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 14 16:53:51.747015 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:51.746633    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 14 16:53:52.746729 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:52.746687    2574 patch_prober.go:28] interesting pod/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 14 16:53:52.747167 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:52.746763    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 14 16:53:53.746207 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:53.746169    2574 patch_prober.go:28] interesting pod/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 14 16:53:53.746385 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:53.746244    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 14 16:53:54.756498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:54.756471    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:54.757601 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:54.757576    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:53:58.253287 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:58.253234    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:53:58.353507 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:53:58.353459    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:54:14.404568 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:14.404528    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:54:14.815670 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:14.815632    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"]
Jul 14 16:54:14.815997 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:14.815969    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72" podUID="32a74af7-6534-4986-b937-86902100837b" containerName="maas-api" containerID="cri-o://eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8" gracePeriod=30
Jul 14 16:54:15.068689 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.068621    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:54:15.174700 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.174654    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a74af7-6534-4986-b937-86902100837b-openshift-service-ca\") pod \"32a74af7-6534-4986-b937-86902100837b\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") "
Jul 14 16:54:15.174926 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.174711    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdhlh\" (UniqueName: \"kubernetes.io/projected/32a74af7-6534-4986-b937-86902100837b-kube-api-access-jdhlh\") pod \"32a74af7-6534-4986-b937-86902100837b\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") "
Jul 14 16:54:15.174926 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.174775    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32a74af7-6534-4986-b937-86902100837b-maas-api-tls\") pod \"32a74af7-6534-4986-b937-86902100837b\" (UID: \"32a74af7-6534-4986-b937-86902100837b\") "
Jul 14 16:54:15.175093 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.175069    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32a74af7-6534-4986-b937-86902100837b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "32a74af7-6534-4986-b937-86902100837b" (UID: "32a74af7-6534-4986-b937-86902100837b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:54:15.177078 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.177042    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a74af7-6534-4986-b937-86902100837b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "32a74af7-6534-4986-b937-86902100837b" (UID: "32a74af7-6534-4986-b937-86902100837b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:54:15.177195 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.177133    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a74af7-6534-4986-b937-86902100837b-kube-api-access-jdhlh" (OuterVolumeSpecName: "kube-api-access-jdhlh") pod "32a74af7-6534-4986-b937-86902100837b" (UID: "32a74af7-6534-4986-b937-86902100837b"). InnerVolumeSpecName "kube-api-access-jdhlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:54:15.244423 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.244367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:54:15.276043 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.276005    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a74af7-6534-4986-b937-86902100837b-openshift-service-ca\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:54:15.276043 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.276035    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdhlh\" (UniqueName: \"kubernetes.io/projected/32a74af7-6534-4986-b937-86902100837b-kube-api-access-jdhlh\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:54:15.276043 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.276046    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32a74af7-6534-4986-b937-86902100837b-maas-api-tls\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:54:15.755852 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.755820    2574 generic.go:356] "Generic (PLEG): container finished" podID="32a74af7-6534-4986-b937-86902100837b" containerID="eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8" exitCode=0
Jul 14 16:54:15.756324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.755886    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"
Jul 14 16:54:15.756324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.755896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72" event={"ID":"32a74af7-6534-4986-b937-86902100837b","Type":"ContainerDied","Data":"eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8"}
Jul 14 16:54:15.756324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.755946    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72" event={"ID":"32a74af7-6534-4986-b937-86902100837b","Type":"ContainerDied","Data":"c9531d465da900fbeba3f464cf19777aa01de7aba6095b2253756861e3b5a5c5"}
Jul 14 16:54:15.756324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.755971    2574 scope.go:117] "RemoveContainer" containerID="eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8"
Jul 14 16:54:15.767607 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.767586    2574 scope.go:117] "RemoveContainer" containerID="eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8"
Jul 14 16:54:15.767962 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:54:15.767940    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8\": container with ID starting with eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8 not found: ID does not exist" containerID="eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8"
Jul 14 16:54:15.768060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.767974    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8"} err="failed to get container status \"eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8\": rpc error: code = NotFound desc = could not find container \"eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8\": container with ID starting with eac1ac75afc473483cd374bb01b2b663650d1c781af742d59f57cdde1cbbdbc8 not found: ID does not exist"
Jul 14 16:54:15.779040 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.779006    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"]
Jul 14 16:54:15.782282 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:15.782253    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-c316bd01-7b649fb9f4-m6b72"]
Jul 14 16:54:16.761587 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:16.761549    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a74af7-6534-4986-b937-86902100837b" path="/var/lib/kubelet/pods/32a74af7-6534-4986-b937-86902100837b/volumes"
Jul 14 16:54:20.602648 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:20.602604    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:54:25.659597 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:54:25.659552    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:02.429128 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:02.429081    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:05.508859 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:05.508817    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:09.181303 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:09.181267    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:09.281049 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:09.281005    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:09.441756 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:09.441657    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"]
Jul 14 16:55:09.441941 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:09.441916    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy" containerID="cri-o://6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40" gracePeriod=30
Jul 14 16:55:09.459255 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:09.459217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:09.759695 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:09.759659    2574 patch_prober.go:28] interesting pod/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 16:55:09.759853 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:09.759715    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:55:09.966481 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:09.966447    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:10.793725 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:10.793695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:10.893578 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:10.893545    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:10.992496 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:10.992455    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:11.754845 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:11.754805    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:11.858851 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:11.858764    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:11.952814 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:11.952740    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:13.398431 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:13.398393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:14.704641 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.704577    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:55:14.740827 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.740772    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-credential-socket\") pod \"9ff69300-eca6-4cb9-a920-1f022007ff40\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") "
Jul 14 16:55:14.741023 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.740852    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-token\") pod \"9ff69300-eca6-4cb9-a920-1f022007ff40\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") "
Jul 14 16:55:14.741023 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.740870    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-data\") pod \"9ff69300-eca6-4cb9-a920-1f022007ff40\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") "
Jul 14 16:55:14.741023 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.740915    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-envoy\") pod \"9ff69300-eca6-4cb9-a920-1f022007ff40\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") "
Jul 14 16:55:14.741023 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.740942    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-podinfo\") pod \"9ff69300-eca6-4cb9-a920-1f022007ff40\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") "
Jul 14 16:55:14.741216 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.741023    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzt2v\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-kube-api-access-mzt2v\") pod \"9ff69300-eca6-4cb9-a920-1f022007ff40\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") "
Jul 14 16:55:14.741216 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.741047    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-socket\") pod \"9ff69300-eca6-4cb9-a920-1f022007ff40\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") "
Jul 14 16:55:14.741216 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.741082    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff69300-eca6-4cb9-a920-1f022007ff40-istiod-ca-cert\") pod \"9ff69300-eca6-4cb9-a920-1f022007ff40\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") "
Jul 14 16:55:14.741216 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.741123    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-certs\") pod \"9ff69300-eca6-4cb9-a920-1f022007ff40\" (UID: \"9ff69300-eca6-4cb9-a920-1f022007ff40\") "
Jul 14 16:55:14.741216 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.741137    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ff69300-eca6-4cb9-a920-1f022007ff40" (UID: "9ff69300-eca6-4cb9-a920-1f022007ff40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:55:14.741465 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.741446    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-credential-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:55:14.741568 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.741503    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ff69300-eca6-4cb9-a920-1f022007ff40" (UID: "9ff69300-eca6-4cb9-a920-1f022007ff40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:55:14.741655 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.741561    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ff69300-eca6-4cb9-a920-1f022007ff40" (UID: "9ff69300-eca6-4cb9-a920-1f022007ff40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:55:14.741827 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.741744    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff69300-eca6-4cb9-a920-1f022007ff40-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ff69300-eca6-4cb9-a920-1f022007ff40" (UID: "9ff69300-eca6-4cb9-a920-1f022007ff40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:55:14.742160 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.742136    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ff69300-eca6-4cb9-a920-1f022007ff40" (UID: "9ff69300-eca6-4cb9-a920-1f022007ff40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:55:14.743392 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.743366    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ff69300-eca6-4cb9-a920-1f022007ff40" (UID: "9ff69300-eca6-4cb9-a920-1f022007ff40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:55:14.743848 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.743830    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-kube-api-access-mzt2v" (OuterVolumeSpecName: "kube-api-access-mzt2v") pod "9ff69300-eca6-4cb9-a920-1f022007ff40" (UID: "9ff69300-eca6-4cb9-a920-1f022007ff40"). InnerVolumeSpecName "kube-api-access-mzt2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:55:14.743980 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.743960    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ff69300-eca6-4cb9-a920-1f022007ff40" (UID: "9ff69300-eca6-4cb9-a920-1f022007ff40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:55:14.744055 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.743983    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ff69300-eca6-4cb9-a920-1f022007ff40" (UID: "9ff69300-eca6-4cb9-a920-1f022007ff40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:55:14.842219 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.842176    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzt2v\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-kube-api-access-mzt2v\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:55:14.842219 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.842212    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:55:14.842219 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.842222    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff69300-eca6-4cb9-a920-1f022007ff40-istiod-ca-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:55:14.842219 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.842230    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-workload-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:55:14.842498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.842238    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:55:14.842498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.842245    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-data\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:55:14.842498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.842252    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-envoy\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:55:14.842498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:14.842260    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff69300-eca6-4cb9-a920-1f022007ff40-istio-podinfo\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:55:15.041172 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.041136    2574 generic.go:356] "Generic (PLEG): container finished" podID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerID="6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40" exitCode=0
Jul 14 16:55:15.041390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.041196    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"
Jul 14 16:55:15.041390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.041198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" event={"ID":"9ff69300-eca6-4cb9-a920-1f022007ff40","Type":"ContainerDied","Data":"6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40"}
Jul 14 16:55:15.041390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.041337    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7" event={"ID":"9ff69300-eca6-4cb9-a920-1f022007ff40","Type":"ContainerDied","Data":"7cb944066fbfbaf8dc56e257c3c1d202be5d93a5c508fc4fa10854aa52ebd4ff"}
Jul 14 16:55:15.041390 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.041370    2574 scope.go:117] "RemoveContainer" containerID="6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40"
Jul 14 16:55:15.051097 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.051072    2574 scope.go:117] "RemoveContainer" containerID="96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26"
Jul 14 16:55:15.059750 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.059725    2574 scope.go:117] "RemoveContainer" containerID="6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40"
Jul 14 16:55:15.060240 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:55:15.060217    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40\": container with ID starting with 6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40 not found: ID does not exist" containerID="6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40"
Jul 14 16:55:15.060342 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.060252    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40"} err="failed to get container status \"6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40\": rpc error: code = NotFound desc = could not find container \"6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40\": container with ID starting with 6a436566b5adf84b4339b1da1e229efab2653e192895730ff7a705146c30df40 not found: ID does not exist"
Jul 14 16:55:15.060342 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.060280    2574 scope.go:117] "RemoveContainer" containerID="96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26"
Jul 14 16:55:15.060550 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:55:15.060531    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26\": container with ID starting with 96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26 not found: ID does not exist" containerID="96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26"
Jul 14 16:55:15.060593 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.060557    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26"} err="failed to get container status \"96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26\": rpc error: code = NotFound desc = could not find container \"96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26\": container with ID starting with 96c27387dbbd1332c9a9a3b5ad46b6c4b873c73ee43423005a3f08e98adeda26 not found: ID does not exist"
Jul 14 16:55:15.065361 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.065328    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"]
Jul 14 16:55:15.071318 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:15.071290    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c316bd01-openshift-default-78d7db66b7-nqzx7"]
Jul 14 16:55:16.756030 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:16.755994    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" path="/var/lib/kubelet/pods/9ff69300-eca6-4cb9-a920-1f022007ff40/volumes"
Jul 14 16:55:19.223079 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:19.223029    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:19.323680 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:19.323649    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:19.938506 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:19.938466    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:26.854015 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:26.853975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:27.026280 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:27.026236    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:27.138257 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:27.138143    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:37.660501 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:37.660459    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:39.099186 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:39.099148    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:55:59.001137 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:55:59.001104    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:05.733105 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.733034    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:05.834288 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.834255    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:05.966495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.966458    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"]
Jul 14 16:56:05.966857 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.966842    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy"
Jul 14 16:56:05.966857 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.966858    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy"
Jul 14 16:56:05.966954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.966877    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy"
Jul 14 16:56:05.966954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.966882    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy"
Jul 14 16:56:05.966954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.966887    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a74af7-6534-4986-b937-86902100837b" containerName="maas-api"
Jul 14 16:56:05.966954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.966893    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a74af7-6534-4986-b937-86902100837b" containerName="maas-api"
Jul 14 16:56:05.966954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.966951    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy"
Jul 14 16:56:05.967108 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.966959    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="32a74af7-6534-4986-b937-86902100837b" containerName="maas-api"
Jul 14 16:56:05.969862 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.969845    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:05.972475 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.972450    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-528a5c-openshift-default-dockercfg-khgsx\""
Jul 14 16:56:05.976912 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.976814    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:05.985190 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:05.985113    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"]
Jul 14 16:56:06.007149 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.007113    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2zlf\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-kube-api-access-p2zlf\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.007340 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.007158    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-socket\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.007340 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.007223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831368ce-6d04-49ce-a47b-308f53aae324-istiod-ca-cert\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.007340 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.007277    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-data\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.007340 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.007299    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-istio-token\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.007569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.007415    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-certs\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.007569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.007448    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831368ce-6d04-49ce-a47b-308f53aae324-istio-podinfo\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.007569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.007475    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-credential-socket\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.007569 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.007492    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-envoy\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.108817 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.108764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-certs\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.108817 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.108814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831368ce-6d04-49ce-a47b-308f53aae324-istio-podinfo\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.108836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-credential-socket\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.108854    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-envoy\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.108903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2zlf\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-kube-api-access-p2zlf\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.108930    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-socket\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.108962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831368ce-6d04-49ce-a47b-308f53aae324-istiod-ca-cert\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.109015    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-data\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.109040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-istio-token\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.109248    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-certs\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.109263    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-credential-socket\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109477 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.109360    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-socket\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109641 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.109503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-data\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.109891 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.109870    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831368ce-6d04-49ce-a47b-308f53aae324-istiod-ca-cert\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.111413 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.111390    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-envoy\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.111734 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.111717    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831368ce-6d04-49ce-a47b-308f53aae324-istio-podinfo\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.117769 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.117740    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-istio-token\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.117940 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.117922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2zlf\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-kube-api-access-p2zlf\") pod \"e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") " pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.280764 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.280727    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:06.377839 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.377774    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:06.438324 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.438290    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"]
Jul 14 16:56:06.442226 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:56:06.442189    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831368ce_6d04_49ce_a47b_308f53aae324.slice/crio-15885f456ccd754b2308de8eb1d16121e247fa9ba243452866842bc46d7b4734 WatchSource:0}: Error finding container 15885f456ccd754b2308de8eb1d16121e247fa9ba243452866842bc46d7b4734: Status 404 returned error can't find the container with id 15885f456ccd754b2308de8eb1d16121e247fa9ba243452866842bc46d7b4734
Jul 14 16:56:06.445598 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.445560    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:56:06.445696 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.445635    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:56:06.445696 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.445663    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:56:06.768465 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.768434    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:56:06.772121 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:06.772095    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 16:56:07.304685 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:07.304648    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" event={"ID":"831368ce-6d04-49ce-a47b-308f53aae324","Type":"ContainerStarted","Data":"467f19f9da10a395a65c282af37b8c1752b0355307b0a49f1e887661305cf1df"}
Jul 14 16:56:07.304889 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:07.304712    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" event={"ID":"831368ce-6d04-49ce-a47b-308f53aae324","Type":"ContainerStarted","Data":"15885f456ccd754b2308de8eb1d16121e247fa9ba243452866842bc46d7b4734"}
Jul 14 16:56:07.332095 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:07.332034    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" podStartSLOduration=2.332014691 podStartE2EDuration="2.332014691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:56:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:56:07.330097337 +0000 UTC m=+1801.109261272" watchObservedRunningTime="2026-07-14 16:56:07.332014691 +0000 UTC m=+1801.111178627"
Jul 14 16:56:08.281093 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:08.281046    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:08.286327 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:08.286301    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:08.310257 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:08.310223    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:08.311362 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:08.311340    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:09.689446 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.689404    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"]
Jul 14 16:56:09.690243 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.690104    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff69300-eca6-4cb9-a920-1f022007ff40" containerName="istio-proxy"
Jul 14 16:56:09.694860 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.694829    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:09.697267 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.697244    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-528a5c-serving-cert\""
Jul 14 16:56:09.701395 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.701364    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"]
Jul 14 16:56:09.746990 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.746947    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:09.746990 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.746995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqdvz\" (UniqueName: \"kubernetes.io/projected/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-kube-api-access-fqdvz\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:09.747266 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.747089    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-maas-api-tls\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:09.848268 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.848215    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqdvz\" (UniqueName: \"kubernetes.io/projected/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-kube-api-access-fqdvz\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:09.848461 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.848285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-maas-api-tls\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:09.848461 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:56:09.848409    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-528a5c-serving-cert: secret "maas-api-e2e-inf-a-528a5c-serving-cert" not found
Jul 14 16:56:09.848559 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.848463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:09.848559 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:56:09.848471    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-maas-api-tls podName:e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5 nodeName:}" failed. No retries permitted until 2026-07-14 16:56:10.34845042 +0000 UTC m=+1804.127614338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-maas-api-tls") pod "maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9" (UID: "e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5") : secret "maas-api-e2e-inf-a-528a5c-serving-cert" not found
Jul 14 16:56:09.849193 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.849173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:09.858495 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:09.858464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqdvz\" (UniqueName: \"kubernetes.io/projected/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-kube-api-access-fqdvz\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:10.004502 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:10.004468    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:10.105356 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:10.105312    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:10.353594 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:10.353487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-maas-api-tls\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:10.356409 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:10.356376    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-maas-api-tls\") pod \"maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") " pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:10.607823 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:10.607678    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:10.757890 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:10.757860    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"]
Jul 14 16:56:10.758911 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:56:10.758885    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46e1870_0d5e_4ecd_83a3_fd70ee7df0b5.slice/crio-8c53efd8b3c734a937c2c5526f2ff88548ba638cb9b2caab16926343badbccf8 WatchSource:0}: Error finding container 8c53efd8b3c734a937c2c5526f2ff88548ba638cb9b2caab16926343badbccf8: Status 404 returned error can't find the container with id 8c53efd8b3c734a937c2c5526f2ff88548ba638cb9b2caab16926343badbccf8
Jul 14 16:56:10.760288 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:10.760270    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:56:11.123899 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:11.123852    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:11.226664 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:11.226612    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:11.325025 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:11.324991    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9" event={"ID":"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5","Type":"ContainerStarted","Data":"8c53efd8b3c734a937c2c5526f2ff88548ba638cb9b2caab16926343badbccf8"}
Jul 14 16:56:12.331984 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:12.331941    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9" event={"ID":"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5","Type":"ContainerStarted","Data":"260bc53c3dce9185bc272e31c66a8589f2df78d2f772b7d5eca564a85003cd7b"}
Jul 14 16:56:12.332373 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:12.332098    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:12.349240 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:12.349185    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9" podStartSLOduration=1.987385686 podStartE2EDuration="3.349169241s" totalImagesPullingTime="1.361783555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:56:12.347690771 +0000 UTC m=+1806.126854731" watchObservedRunningTime="2026-07-14 16:56:12.349169241 +0000 UTC m=+1806.128333176"
Jul 14 16:56:15.195875 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:15.195836    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:15.285135 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:15.285093    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:18.343217 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:18.343187    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:56:23.508209 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:23.508165    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:23.647907 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:23.647770    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:23.749074 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:23.749043    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:24.352979 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:24.352930    2574 patch_prober.go:28] interesting pod/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 16:56:24.353164 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:24.353022    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 16:56:24.589727 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:24.589690    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:24.693321 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:24.693281    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:25.406679 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:25.406632    2574 generic.go:356] "Generic (PLEG): container finished" podID="831368ce-6d04-49ce-a47b-308f53aae324" containerID="467f19f9da10a395a65c282af37b8c1752b0355307b0a49f1e887661305cf1df" exitCode=0
Jul 14 16:56:25.406896 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:25.406706    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" event={"ID":"831368ce-6d04-49ce-a47b-308f53aae324","Type":"ContainerDied","Data":"467f19f9da10a395a65c282af37b8c1752b0355307b0a49f1e887661305cf1df"}
Jul 14 16:56:25.407202 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:25.407181    2574 scope.go:117] "RemoveContainer" containerID="467f19f9da10a395a65c282af37b8c1752b0355307b0a49f1e887661305cf1df"
Jul 14 16:56:25.408270 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:25.408195    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:56:25.408339 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:25.408309    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:56:25.408379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:25.408340    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:56:26.413720 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:26.413678    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" event={"ID":"831368ce-6d04-49ce-a47b-308f53aae324","Type":"ContainerStarted","Data":"832aa59520b466d9283d502e8fa0b20752b8a799777eb9237947695bcb419743"}
Jul 14 16:56:27.281394 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:27.281342    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:27.281833 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:27.281802    2574 patch_prober.go:28] interesting pod/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 14 16:56:27.281947 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:27.281875    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 14 16:56:28.043207 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:28.043166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:28.282058 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:28.282013    2574 patch_prober.go:28] interesting pod/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 14 16:56:28.282358 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:28.282326    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 14 16:56:29.281459 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:29.281413    2574 patch_prober.go:28] interesting pod/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 14 16:56:29.282088 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:29.282047    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 14 16:56:30.281409 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:30.281361    2574 patch_prober.go:28] interesting pod/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 14 16:56:30.281756 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:30.281719    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 14 16:56:31.284650 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:31.284616    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:31.285166 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:31.285085    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:31.285667 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:31.285646    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:56:31.913241 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:31.913206    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:32.022579 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:32.022538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:36.504312 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:36.504275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:45.512161 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:45.512109    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:45.613494 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:45.613454    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:56:54.838839 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:56:54.838767    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:57:26.656368 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:26.656277    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:57:27.632149 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:27.632106    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:57:27.798336 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:27.798298    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:57:28.208888 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.208848    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:57:28.313462 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.313429    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:57:28.414342 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.414308    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:57:28.546070 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.546030    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"]
Jul 14 16:57:28.546348 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.546312    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9" podUID="e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5" containerName="maas-api" containerID="cri-o://260bc53c3dce9185bc272e31c66a8589f2df78d2f772b7d5eca564a85003cd7b" gracePeriod=30
Jul 14 16:57:28.585377 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.585340    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:57:28.725331 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.725292    2574 generic.go:356] "Generic (PLEG): container finished" podID="e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5" containerID="260bc53c3dce9185bc272e31c66a8589f2df78d2f772b7d5eca564a85003cd7b" exitCode=0
Jul 14 16:57:28.725503 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.725379    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9" event={"ID":"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5","Type":"ContainerDied","Data":"260bc53c3dce9185bc272e31c66a8589f2df78d2f772b7d5eca564a85003cd7b"}
Jul 14 16:57:28.796717 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.796638    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:57:28.888013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.887968    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqdvz\" (UniqueName: \"kubernetes.io/projected/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-kube-api-access-fqdvz\") pod \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") "
Jul 14 16:57:28.888409 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.888043    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-maas-api-tls\") pod \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") "
Jul 14 16:57:28.888409 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.888085    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-openshift-service-ca\") pod \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\" (UID: \"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5\") "
Jul 14 16:57:28.888560 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.888526    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5" (UID: "e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:57:28.890483 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.890451    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5" (UID: "e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:57:28.890599 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.890549    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-kube-api-access-fqdvz" (OuterVolumeSpecName: "kube-api-access-fqdvz") pod "e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5" (UID: "e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5"). InnerVolumeSpecName "kube-api-access-fqdvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:57:28.989417 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.989372    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqdvz\" (UniqueName: \"kubernetes.io/projected/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-kube-api-access-fqdvz\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:57:28.989417 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.989417    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-maas-api-tls\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:57:28.989634 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:28.989430    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5-openshift-service-ca\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:57:29.732109 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:29.732074    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"
Jul 14 16:57:29.732302 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:29.732073    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9" event={"ID":"e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5","Type":"ContainerDied","Data":"8c53efd8b3c734a937c2c5526f2ff88548ba638cb9b2caab16926343badbccf8"}
Jul 14 16:57:29.732302 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:29.732241    2574 scope.go:117] "RemoveContainer" containerID="260bc53c3dce9185bc272e31c66a8589f2df78d2f772b7d5eca564a85003cd7b"
Jul 14 16:57:29.755020 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:29.754982    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"]
Jul 14 16:57:29.759354 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:29.759322    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-528a5c-84b79b6b54-qcbq9"]
Jul 14 16:57:30.756284 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:30.756249    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5" path="/var/lib/kubelet/pods/e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5/volumes"
Jul 14 16:57:33.284329 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:57:33.284292    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:10.729138 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:10.729093    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"]
Jul 14 16:58:10.729659 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:10.729385    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy" containerID="cri-o://832aa59520b466d9283d502e8fa0b20752b8a799777eb9237947695bcb419743" gracePeriod=30
Jul 14 16:58:11.824799 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:11.824740    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:11.924163 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:11.924125    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:12.101711 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:12.101613    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:15.952864 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:15.952830    2574 generic.go:356] "Generic (PLEG): container finished" podID="831368ce-6d04-49ce-a47b-308f53aae324" containerID="832aa59520b466d9283d502e8fa0b20752b8a799777eb9237947695bcb419743" exitCode=0
Jul 14 16:58:15.953279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:15.952909    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" event={"ID":"831368ce-6d04-49ce-a47b-308f53aae324","Type":"ContainerDied","Data":"832aa59520b466d9283d502e8fa0b20752b8a799777eb9237947695bcb419743"}
Jul 14 16:58:15.953279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:15.952979    2574 scope.go:117] "RemoveContainer" containerID="467f19f9da10a395a65c282af37b8c1752b0355307b0a49f1e887661305cf1df"
Jul 14 16:58:15.996986 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:15.996912    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:58:16.125643 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.125597    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-data\") pod \"831368ce-6d04-49ce-a47b-308f53aae324\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") "
Jul 14 16:58:16.125643 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.125642    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-credential-socket\") pod \"831368ce-6d04-49ce-a47b-308f53aae324\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") "
Jul 14 16:58:16.125954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.125671    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2zlf\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-kube-api-access-p2zlf\") pod \"831368ce-6d04-49ce-a47b-308f53aae324\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") "
Jul 14 16:58:16.125954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.125694    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-envoy\") pod \"831368ce-6d04-49ce-a47b-308f53aae324\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") "
Jul 14 16:58:16.125954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.125718    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-certs\") pod \"831368ce-6d04-49ce-a47b-308f53aae324\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") "
Jul 14 16:58:16.125954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.125771    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-istio-token\") pod \"831368ce-6d04-49ce-a47b-308f53aae324\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") "
Jul 14 16:58:16.125954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.125870    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-socket\") pod \"831368ce-6d04-49ce-a47b-308f53aae324\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") "
Jul 14 16:58:16.125954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.125894    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831368ce-6d04-49ce-a47b-308f53aae324-istiod-ca-cert\") pod \"831368ce-6d04-49ce-a47b-308f53aae324\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") "
Jul 14 16:58:16.125954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.125936    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831368ce-6d04-49ce-a47b-308f53aae324-istio-podinfo\") pod \"831368ce-6d04-49ce-a47b-308f53aae324\" (UID: \"831368ce-6d04-49ce-a47b-308f53aae324\") "
Jul 14 16:58:16.126284 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.126008    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "831368ce-6d04-49ce-a47b-308f53aae324" (UID: "831368ce-6d04-49ce-a47b-308f53aae324"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:16.126284 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.126116    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "831368ce-6d04-49ce-a47b-308f53aae324" (UID: "831368ce-6d04-49ce-a47b-308f53aae324"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:16.126284 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.126224    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "831368ce-6d04-49ce-a47b-308f53aae324" (UID: "831368ce-6d04-49ce-a47b-308f53aae324"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:16.126284 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.126277    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-credential-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:16.126544 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.126295    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:16.126544 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.126422    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/831368ce-6d04-49ce-a47b-308f53aae324-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "831368ce-6d04-49ce-a47b-308f53aae324" (UID: "831368ce-6d04-49ce-a47b-308f53aae324"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:58:16.126856 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.126827    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-data" (OuterVolumeSpecName: "istio-data") pod "831368ce-6d04-49ce-a47b-308f53aae324" (UID: "831368ce-6d04-49ce-a47b-308f53aae324"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:16.128297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.128262    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/831368ce-6d04-49ce-a47b-308f53aae324-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "831368ce-6d04-49ce-a47b-308f53aae324" (UID: "831368ce-6d04-49ce-a47b-308f53aae324"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:58:16.128297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.128277    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-kube-api-access-p2zlf" (OuterVolumeSpecName: "kube-api-access-p2zlf") pod "831368ce-6d04-49ce-a47b-308f53aae324" (UID: "831368ce-6d04-49ce-a47b-308f53aae324"). InnerVolumeSpecName "kube-api-access-p2zlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:58:16.128586 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.128567    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "831368ce-6d04-49ce-a47b-308f53aae324" (UID: "831368ce-6d04-49ce-a47b-308f53aae324"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:16.128586 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.128575    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-istio-token" (OuterVolumeSpecName: "istio-token") pod "831368ce-6d04-49ce-a47b-308f53aae324" (UID: "831368ce-6d04-49ce-a47b-308f53aae324"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:58:16.227801 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.227751    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-workload-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:16.227801 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.227804    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831368ce-6d04-49ce-a47b-308f53aae324-istiod-ca-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:16.228028 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.227817    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831368ce-6d04-49ce-a47b-308f53aae324-istio-podinfo\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:16.228028 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.227830    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-data\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:16.228028 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.227841    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2zlf\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-kube-api-access-p2zlf\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:16.228028 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.227853    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831368ce-6d04-49ce-a47b-308f53aae324-istio-envoy\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:16.228028 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.227864    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831368ce-6d04-49ce-a47b-308f53aae324-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:16.960883 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.960842    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v" event={"ID":"831368ce-6d04-49ce-a47b-308f53aae324","Type":"ContainerDied","Data":"15885f456ccd754b2308de8eb1d16121e247fa9ba243452866842bc46d7b4734"}
Jul 14 16:58:16.961460 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.960907    2574 scope.go:117] "RemoveContainer" containerID="832aa59520b466d9283d502e8fa0b20752b8a799777eb9237947695bcb419743"
Jul 14 16:58:16.961460 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.960868    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"
Jul 14 16:58:16.982681 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.982628    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"]
Jul 14 16:58:16.986159 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:16.986126    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-528a5c-openshift-default-d767558f7-vnh7v"]
Jul 14 16:58:17.983698 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:17.983667    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:18.450614 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:18.450564    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:18.552238 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:18.552199    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:18.651322 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:18.651290    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:18.756754 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:18.756722    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="831368ce-6d04-49ce-a47b-308f53aae324" path="/var/lib/kubelet/pods/831368ce-6d04-49ce-a47b-308f53aae324/volumes"
Jul 14 16:58:18.880921 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:18.880866    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:19.189821 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.189723    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"]
Jul 14 16:58:19.190224 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.190179    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy"
Jul 14 16:58:19.190224 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.190194    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy"
Jul 14 16:58:19.190339 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.190230    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5" containerName="maas-api"
Jul 14 16:58:19.190339 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.190239    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5" containerName="maas-api"
Jul 14 16:58:19.190339 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.190335    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy"
Jul 14 16:58:19.190465 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.190350    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy"
Jul 14 16:58:19.190465 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.190361    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e46e1870-0d5e-4ecd-83a3-fd70ee7df0b5" containerName="maas-api"
Jul 14 16:58:19.194886 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.194860    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.197223 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.197200    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7f8436-openshift-default-dockercfg-4fjdb\""
Jul 14 16:58:19.206686 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.206651    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"]
Jul 14 16:58:19.224498 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.224450    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:19.356999 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.356957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-certs\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.356999 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.356998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-data\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.357229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.357050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-podinfo\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.357229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.357083    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4fnn\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-kube-api-access-s4fnn\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.357229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.357120    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-credential-socket\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.357229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.357148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istiod-ca-cert\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.357229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.357166    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-socket\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.357438 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.357233    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-envoy\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.357438 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.357262    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-token\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.388184 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.388155    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:19.458867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.458741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-certs\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.458867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.458819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-data\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.458867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.458842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-podinfo\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.458867 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.458868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4fnn\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-kube-api-access-s4fnn\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.458900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-credential-socket\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.459022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istiod-ca-cert\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.459064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-socket\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.459118    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-envoy\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.459153    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-token\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459229 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.459222    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-certs\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459497 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.459335    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-data\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459497 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.459381    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-credential-socket\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459497 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.459441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-socket\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.459989 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.459965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istiod-ca-cert\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.461530 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.461505    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-envoy\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.461656 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.461635    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-podinfo\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.469140 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.469112    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-token\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.469458 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.469436    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4fnn\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-kube-api-access-s4fnn\") pod \"e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") " pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.507231 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.507194    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:19.652776 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.652744    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"]
Jul 14 16:58:19.654907 ip-10-0-130-193 kubenswrapper[2574]: W0714 16:58:19.654876    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd234cf_fbe7_44bc_b031_2c94b5697dba.slice/crio-149541def864d489e7a971a9812c1250844dcc11d36953729c4f01c79123758c WatchSource:0}: Error finding container 149541def864d489e7a971a9812c1250844dcc11d36953729c4f01c79123758c: Status 404 returned error can't find the container with id 149541def864d489e7a971a9812c1250844dcc11d36953729c4f01c79123758c
Jul 14 16:58:19.657138 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.657108    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:58:19.657244 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.657176    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:58:19.657244 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.657204    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:58:19.978036 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.977930    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" event={"ID":"2bd234cf-fbe7-44bc-b031-2c94b5697dba","Type":"ContainerStarted","Data":"faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c"}
Jul 14 16:58:19.978036 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.978000    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" event={"ID":"2bd234cf-fbe7-44bc-b031-2c94b5697dba","Type":"ContainerStarted","Data":"149541def864d489e7a971a9812c1250844dcc11d36953729c4f01c79123758c"}
Jul 14 16:58:19.999458 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:19.999404    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" podStartSLOduration=0.99938693 podStartE2EDuration="999.38693ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:58:19.99767972 +0000 UTC m=+1933.776843657" watchObservedRunningTime="2026-07-14 16:58:19.99938693 +0000 UTC m=+1933.778550927"
Jul 14 16:58:20.508089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:20.508049    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:20.513293 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:20.513262    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:20.983389 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:20.983296    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:20.984382 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:20.984359    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:22.065155 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:22.065113    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:22.268864 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:22.268833    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:22.680553 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:22.680516    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:22.785180 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:22.785149    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:23.049311 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:23.049258    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:23.148279 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:23.148245    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:26.603201 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:26.603164    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:27.150420 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:27.150384    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:27.706481 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:27.706437    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:27.881808 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:27.881750    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:31.362151 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:31.362109    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:31.546823 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:31.546768    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:31.698291 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:31.698193    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:31.915615 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:31.915572    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:32.230959 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:32.230916    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:32.332621 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:32.332581    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:35.844001 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:35.843958    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:36.925000 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:36.924366    2574 patch_prober.go:28] interesting pod/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:35128->10.133.0.59:15021: read: connection reset by peer" start-of-body=
Jul 14 16:58:36.925000 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:36.924433    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:35128->10.133.0.59:15021: read: connection reset by peer"
Jul 14 16:58:37.060305 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:37.060275    2574 generic.go:356] "Generic (PLEG): container finished" podID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerID="faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c" exitCode=0
Jul 14 16:58:37.060501 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:37.060358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" event={"ID":"2bd234cf-fbe7-44bc-b031-2c94b5697dba","Type":"ContainerDied","Data":"faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c"}
Jul 14 16:58:37.060807 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:37.060773    2574 scope.go:117] "RemoveContainer" containerID="faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c"
Jul 14 16:58:37.061869 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:37.061842    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:58:37.061954 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:37.061926    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:58:37.061999 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:37.061986    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:58:38.067918 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:38.067883    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" event={"ID":"2bd234cf-fbe7-44bc-b031-2c94b5697dba","Type":"ContainerStarted","Data":"fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672"}
Jul 14 16:58:38.278897 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:38.278849    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:38.508160 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:38.508113    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:38.508363 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:38.508340    2574 patch_prober.go:28] interesting pod/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 14 16:58:38.508423 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:38.508403    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 14 16:58:39.507599 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:39.507563    2574 patch_prober.go:28] interesting pod/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 14 16:58:39.508190 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:39.507642    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 14 16:58:39.782246 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:39.782114    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:39.884091 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:39.884029    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:40.508295 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:40.508250    2574 patch_prober.go:28] interesting pod/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 14 16:58:40.508707 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:40.508312    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 14 16:58:41.508194 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:41.508156    2574 patch_prober.go:28] interesting pod/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 14 16:58:41.508402 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:41.508229    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 14 16:58:42.511313 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:42.511276    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:42.511763 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:42.511547    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:42.512261 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:42.512243    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:44.194929 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:44.194888    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:44.575922 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:44.575877    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:44.752407 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:44.752367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:44.854811 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:44.854693    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:45.031332 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:45.031294    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:50.553326 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:50.553287    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:50.650976 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:50.650929    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:50.798056 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:50.798022    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"]
Jul 14 16:58:50.798269 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:50.798244    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy" containerID="cri-o://fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672" gracePeriod=30
Jul 14 16:58:50.819138 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:50.819047    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:51.053751 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:51.053707    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:51.409274 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:51.409245    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:51.794080 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:51.794033    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:51.964106 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:51.964061    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:53.204227 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:53.204191    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:53.303458 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:53.303402    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:56.063327 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.063255    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:56.190297 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.190261    2574 generic.go:356] "Generic (PLEG): container finished" podID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerID="fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672" exitCode=0
Jul 14 16:58:56.190469 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.190315    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"
Jul 14 16:58:56.190469 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.190346    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" event={"ID":"2bd234cf-fbe7-44bc-b031-2c94b5697dba","Type":"ContainerDied","Data":"fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672"}
Jul 14 16:58:56.190469 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.190397    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd" event={"ID":"2bd234cf-fbe7-44bc-b031-2c94b5697dba","Type":"ContainerDied","Data":"149541def864d489e7a971a9812c1250844dcc11d36953729c4f01c79123758c"}
Jul 14 16:58:56.190469 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.190422    2574 scope.go:117] "RemoveContainer" containerID="fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672"
Jul 14 16:58:56.199327 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.199305    2574 scope.go:117] "RemoveContainer" containerID="faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c"
Jul 14 16:58:56.207712 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.207692    2574 scope.go:117] "RemoveContainer" containerID="fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672"
Jul 14 16:58:56.208102 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:58:56.208083    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672\": container with ID starting with fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672 not found: ID does not exist" containerID="fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672"
Jul 14 16:58:56.208162 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.208113    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672"} err="failed to get container status \"fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672\": rpc error: code = NotFound desc = could not find container \"fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672\": container with ID starting with fe4914b7411cca21dde904d1549e15b35265cf7a730aea777afd7544adfba672 not found: ID does not exist"
Jul 14 16:58:56.208162 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.208134    2574 scope.go:117] "RemoveContainer" containerID="faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c"
Jul 14 16:58:56.208380 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:58:56.208360    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c\": container with ID starting with faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c not found: ID does not exist" containerID="faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c"
Jul 14 16:58:56.208420 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.208388    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c"} err="failed to get container status \"faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c\": rpc error: code = NotFound desc = could not find container \"faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c\": container with ID starting with faf63f6582243aff867a92d57bb09048ffc892b69ed2ab551354d953b1b1593c not found: ID does not exist"
Jul 14 16:58:56.242746 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.242707    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-podinfo\") pod \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") "
Jul 14 16:58:56.242956 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.242809    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4fnn\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-kube-api-access-s4fnn\") pod \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") "
Jul 14 16:58:56.242956 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.242849    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-certs\") pod \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") "
Jul 14 16:58:56.242956 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.242882    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-data\") pod \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") "
Jul 14 16:58:56.242956 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.242918    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-credential-socket\") pod \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") "
Jul 14 16:58:56.242956 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.242939    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-envoy\") pod \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") "
Jul 14 16:58:56.243228 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.243046    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istiod-ca-cert\") pod \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") "
Jul 14 16:58:56.243228 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.243071    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-token\") pod \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") "
Jul 14 16:58:56.243228 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.243073    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2bd234cf-fbe7-44bc-b031-2c94b5697dba" (UID: "2bd234cf-fbe7-44bc-b031-2c94b5697dba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:56.243228 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.243110    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-socket\") pod \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\" (UID: \"2bd234cf-fbe7-44bc-b031-2c94b5697dba\") "
Jul 14 16:58:56.243428 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.243281    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2bd234cf-fbe7-44bc-b031-2c94b5697dba" (UID: "2bd234cf-fbe7-44bc-b031-2c94b5697dba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:56.243483 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.243459    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:56.243536 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.243480    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-credential-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:56.243536 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.243494    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2bd234cf-fbe7-44bc-b031-2c94b5697dba" (UID: "2bd234cf-fbe7-44bc-b031-2c94b5697dba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:56.243945 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.243743    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2bd234cf-fbe7-44bc-b031-2c94b5697dba" (UID: "2bd234cf-fbe7-44bc-b031-2c94b5697dba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:58:56.244336 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.244304    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-data" (OuterVolumeSpecName: "istio-data") pod "2bd234cf-fbe7-44bc-b031-2c94b5697dba" (UID: "2bd234cf-fbe7-44bc-b031-2c94b5697dba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:56.245416 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.245381    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bd234cf-fbe7-44bc-b031-2c94b5697dba" (UID: "2bd234cf-fbe7-44bc-b031-2c94b5697dba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:58:56.245541 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.245455    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2bd234cf-fbe7-44bc-b031-2c94b5697dba" (UID: "2bd234cf-fbe7-44bc-b031-2c94b5697dba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:58:56.245799 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.245761    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-kube-api-access-s4fnn" (OuterVolumeSpecName: "kube-api-access-s4fnn") pod "2bd234cf-fbe7-44bc-b031-2c94b5697dba" (UID: "2bd234cf-fbe7-44bc-b031-2c94b5697dba"). InnerVolumeSpecName "kube-api-access-s4fnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:58:56.245890 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.245761    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2bd234cf-fbe7-44bc-b031-2c94b5697dba" (UID: "2bd234cf-fbe7-44bc-b031-2c94b5697dba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:58:56.344815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.344682    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istiod-ca-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:56.344815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.344720    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:56.344815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.344733    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-workload-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:56.344815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.344745    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-podinfo\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:56.344815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.344757    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4fnn\" (UniqueName: \"kubernetes.io/projected/2bd234cf-fbe7-44bc-b031-2c94b5697dba-kube-api-access-s4fnn\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:56.344815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.344771    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-data\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:56.344815 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.344800    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bd234cf-fbe7-44bc-b031-2c94b5697dba-istio-envoy\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 16:58:56.516159 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.516115    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"]
Jul 14 16:58:56.520496 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.520467    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7f8436-openshift-default-d6c9b45b7-qc4fd"]
Jul 14 16:58:56.757121 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:56.757083    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" path="/var/lib/kubelet/pods/2bd234cf-fbe7-44bc-b031-2c94b5697dba/volumes"
Jul 14 16:58:58.098289 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:58.098259    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:58.161613 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:58.161578    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:59.271104 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.271065    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"]
Jul 14 16:58:59.271673 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.271648    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy"
Jul 14 16:58:59.271673 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.271673    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy"
Jul 14 16:58:59.271916 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.271708    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy"
Jul 14 16:58:59.271916 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.271717    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="831368ce-6d04-49ce-a47b-308f53aae324" containerName="istio-proxy"
Jul 14 16:58:59.271916 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.271818    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy"
Jul 14 16:58:59.276688 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.276665    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.279557 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.279537    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-584665-openshift-default-dockercfg-6br4s\""
Jul 14 16:58:59.284773 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.284734    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"]
Jul 14 16:58:59.367580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.367529    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-credential-socket\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.367580 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.367578    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3aa359-5153-413a-903e-c62f58769977-istio-podinfo\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.367866 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.367654    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-certs\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.367866 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.367753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-envoy\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.367866 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.367827    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3aa359-5153-413a-903e-c62f58769977-istiod-ca-cert\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.368005 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.367868    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-data\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.368005 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.367905    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs5rk\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-kube-api-access-vs5rk\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.368005 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.367939    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-socket\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.368100 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.368004    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-istio-token\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.429277 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.429239    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:59.469432 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-istio-token\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.469628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469444    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-credential-socket\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.469628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469464    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3aa359-5153-413a-903e-c62f58769977-istio-podinfo\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.469628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-certs\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.469628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469522    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-envoy\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.469628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3aa359-5153-413a-903e-c62f58769977-istiod-ca-cert\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.469628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469572    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-data\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.469628 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469607    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs5rk\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-kube-api-access-vs5rk\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.470060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469633    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-socket\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.470060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469933    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-credential-socket\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.470060 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.469960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-certs\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.470214 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.470075    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-socket\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.470438 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.470219    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-data\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.470493 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.470455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3aa359-5153-413a-903e-c62f58769977-istiod-ca-cert\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.472008 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.471984    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-envoy\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.472254 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.472237    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3aa359-5153-413a-903e-c62f58769977-istio-podinfo\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.480466 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.480445    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-istio-token\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.481094 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.481072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs5rk\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-kube-api-access-vs5rk\") pod \"e2e-shared-a-584665-openshift-default-bb9589459-nfq5d\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") " pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.530907 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.530807    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:58:59.589008 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.588962    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:58:59.827755 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.827032    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"]
Jul 14 16:58:59.829700 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.829655    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:58:59.829878 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.829837    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:58:59.829966 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:58:59.829925    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:59:00.212468 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:00.212369    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" event={"ID":"7c3aa359-5153-413a-903e-c62f58769977","Type":"ContainerStarted","Data":"91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a"}
Jul 14 16:59:00.212468 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:00.212434    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" event={"ID":"7c3aa359-5153-413a-903e-c62f58769977","Type":"ContainerStarted","Data":"f5eb32da61538bbccec6830213ce6784267ffb43d39f5ebd7d814d0d572420ba"}
Jul 14 16:59:00.237421 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:00.237356    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" podStartSLOduration=1.237340601 podStartE2EDuration="1.237340601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:59:00.235412741 +0000 UTC m=+1974.014576676" watchObservedRunningTime="2026-07-14 16:59:00.237340601 +0000 UTC m=+1974.016504537"
Jul 14 16:59:00.590196 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:00.590155    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:59:00.595138 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:00.595108    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:59:01.217326 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:01.217291    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:59:01.218535 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:01.218513    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:59:02.308536 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:02.308486    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:02.405249 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:02.405200    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:02.510911 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:02.510824    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:02.991640 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:02.991603    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:03.091008 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:03.090965    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:06.827562 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:06.827509    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:07.203524 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:07.203433    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:07.560690 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:07.560652    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:08.051208 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:08.051175    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:10.554894 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.554853    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:10.641715 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.641678    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"]
Jul 14 16:59:10.642281 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.642264    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy"
Jul 14 16:59:10.642330 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.642284    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy"
Jul 14 16:59:10.642377 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.642367    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bd234cf-fbe7-44bc-b031-2c94b5697dba" containerName="istio-proxy"
Jul 14 16:59:10.645805 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.645766    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:10.689359 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.689317    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"]
Jul 14 16:59:10.689771 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.689748    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-314eb4-serving-cert\""
Jul 14 16:59:10.701828 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.700346    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6fn9\" (UniqueName: \"kubernetes.io/projected/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-kube-api-access-r6fn9\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:10.701828 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.700455    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-maas-api-tls\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:10.701828 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.700485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-openshift-service-ca\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:10.739651 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.739595    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:10.801379 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.801335    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6fn9\" (UniqueName: \"kubernetes.io/projected/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-kube-api-access-r6fn9\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:10.801607 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.801411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-maas-api-tls\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:10.801607 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.801433    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-openshift-service-ca\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:10.801607 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:59:10.801532    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-314eb4-serving-cert: secret "maas-api-e2e-shared-b-314eb4-serving-cert" not found
Jul 14 16:59:10.801795 ip-10-0-130-193 kubenswrapper[2574]: E0714 16:59:10.801646    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-maas-api-tls podName:08b8f6d0-cd27-4175-a4b5-4a75bb7b1add nodeName:}" failed. No retries permitted until 2026-07-14 16:59:11.301623322 +0000 UTC m=+1985.080787236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-maas-api-tls") pod "maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t" (UID: "08b8f6d0-cd27-4175-a4b5-4a75bb7b1add") : secret "maas-api-e2e-shared-b-314eb4-serving-cert" not found
Jul 14 16:59:10.802128 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.802110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-openshift-service-ca\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:10.815749 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:10.815672    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6fn9\" (UniqueName: \"kubernetes.io/projected/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-kube-api-access-r6fn9\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:11.125542 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:11.125449    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:11.307089 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:11.307044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-maas-api-tls\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:11.309685 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:11.309657    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-maas-api-tls\") pod \"maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") " pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:11.409866 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:11.409738    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:11.556889 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:11.556845    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:11.558192 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:11.558147    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:11.791056 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:11.790930    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"]
Jul 14 16:59:12.270768 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:12.270703    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t" event={"ID":"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add","Type":"ContainerStarted","Data":"bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd"}
Jul 14 16:59:12.271008 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:12.270824    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t" event={"ID":"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add","Type":"ContainerStarted","Data":"6c04da3a6734da7888daa2f447a9049d1eeed91d6eafabdff982e4415548bf26"}
Jul 14 16:59:12.272114 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:12.272084    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:15.131031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:15.130996    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:16.219213 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:16.219172    2574 patch_prober.go:28] interesting pod/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 14 16:59:16.219632 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:16.219232    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 14 16:59:16.292065 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:16.292033    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c3aa359-5153-413a-903e-c62f58769977" containerID="91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a" exitCode=0
Jul 14 16:59:16.292237 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:16.292108    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" event={"ID":"7c3aa359-5153-413a-903e-c62f58769977","Type":"ContainerDied","Data":"91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a"}
Jul 14 16:59:16.292551 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:16.292534    2574 scope.go:117] "RemoveContainer" containerID="91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a"
Jul 14 16:59:16.293574 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:16.293546    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:59:16.293678 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:16.293610    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:59:16.293678 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:16.293643    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:59:16.327533 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:16.327472    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t" podStartSLOduration=5.990608967 podStartE2EDuration="6.327453845s" totalImagesPullingTime="336.844878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:59:12.317047659 +0000 UTC m=+1986.096211595" watchObservedRunningTime="2026-07-14 16:59:16.327453845 +0000 UTC m=+1990.106617788"
Jul 14 16:59:17.300898 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:17.300864    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" event={"ID":"7c3aa359-5153-413a-903e-c62f58769977","Type":"ContainerStarted","Data":"379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856"}
Jul 14 16:59:17.589290 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:17.589180    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:59:17.589577 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:17.589469    2574 patch_prober.go:28] interesting pod/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 14 16:59:17.589743 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:17.589718    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 14 16:59:18.437183 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:18.437142    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:18.590059 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:18.590005    2574 patch_prober.go:28] interesting pod/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 14 16:59:18.590276 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:18.590083    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 14 16:59:19.293187 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:19.293151    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 16:59:19.590013 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:19.589911    2574 patch_prober.go:28] interesting pod/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 14 16:59:19.590610 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:19.590573    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 14 16:59:20.589670 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:20.589623    2574 patch_prober.go:28] interesting pod/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 14 16:59:20.590028 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:20.589995    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 14 16:59:21.594031 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:21.593997    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:59:21.594415 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:21.594355    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:59:21.595034 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:21.595016    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 16:59:24.826294 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:24.826261    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:24.925079 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:24.925050    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:25.037357 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:25.037320    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:31.240830 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:31.240765    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:32.409309 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:32.409275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:32.512338 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:32.512303    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 16:59:58.339223 ip-10-0-130-193 kubenswrapper[2574]: I0714 16:59:58.339176    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:00:36.878408 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:00:36.878319    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:01:06.804222 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:01:06.804192    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 17:01:06.813816 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:01:06.813772    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjkcv_3e29fbf2-e96d-464e-b36b-c479e1c8c63f/ovn-acl-logging/0.log"
Jul 14 17:01:08.432210 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:01:08.432165    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:01:08.490079 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:01:08.490039    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:01:54.435550 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:01:54.435482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:01:55.274361 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:01:55.274320    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:02:03.545841 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:02:03.545770    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:02:26.640441 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:02:26.640401    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:03:04.175048 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:03:04.175008    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:03:05.006336 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:03:05.006300    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:03:13.038835 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:03:13.038770    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:03:33.438091 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:03:33.437994    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:03:40.744614 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:03:40.744579    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:03:40.845399 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:03:40.845362    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:03:58.866057 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:03:58.866017    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:04:17.538505 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:04:17.538465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:04:17.639487 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:04:17.639452    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:04:17.748080 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:04:17.748034    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:04:17.845442 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:04:17.845342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:04:18.008718 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:04:18.008668    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:04:22.704675 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:04:22.704635    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:04:34.970845 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:04:34.970801    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:04:35.056336 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:04:35.056301    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:00.110703 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:00.110594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:00.431687 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:00.431592    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"]
Jul 14 17:05:00.431899 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:00.431877    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy" containerID="cri-o://379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856" gracePeriod=30
Jul 14 17:05:00.471562 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:00.471522    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:00.664690 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:00.664645    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:00.909604 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:00.909568    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:01.133499 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.133461    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"]
Jul 14 17:05:01.133957 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.133696    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t" podUID="08b8f6d0-cd27-4175-a4b5-4a75bb7b1add" containerName="maas-api" containerID="cri-o://bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd" gracePeriod=30
Jul 14 17:05:01.183049 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.182936    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:01.259211 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.259163    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:01.592355 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.592328    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 17:05:01.689481 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.689441    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-openshift-service-ca\") pod \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") "
Jul 14 17:05:01.689665 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.689512    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6fn9\" (UniqueName: \"kubernetes.io/projected/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-kube-api-access-r6fn9\") pod \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") "
Jul 14 17:05:01.689665 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.689605    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-maas-api-tls\") pod \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\" (UID: \"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add\") "
Jul 14 17:05:01.689856 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.689834    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "08b8f6d0-cd27-4175-a4b5-4a75bb7b1add" (UID: "08b8f6d0-cd27-4175-a4b5-4a75bb7b1add"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 17:05:01.689953 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.689931    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-openshift-service-ca\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:01.691821 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.691797    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-kube-api-access-r6fn9" (OuterVolumeSpecName: "kube-api-access-r6fn9") pod "08b8f6d0-cd27-4175-a4b5-4a75bb7b1add" (UID: "08b8f6d0-cd27-4175-a4b5-4a75bb7b1add"). InnerVolumeSpecName "kube-api-access-r6fn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:05:01.691954 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.691900    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "08b8f6d0-cd27-4175-a4b5-4a75bb7b1add" (UID: "08b8f6d0-cd27-4175-a4b5-4a75bb7b1add"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:05:01.791148 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.791101    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6fn9\" (UniqueName: \"kubernetes.io/projected/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-kube-api-access-r6fn9\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:01.791148 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.791139    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add-maas-api-tls\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:01.990010 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.989975    2574 generic.go:356] "Generic (PLEG): container finished" podID="08b8f6d0-cd27-4175-a4b5-4a75bb7b1add" containerID="bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd" exitCode=0
Jul 14 17:05:01.990184 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.990026    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"
Jul 14 17:05:01.990184 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.990036    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t" event={"ID":"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add","Type":"ContainerDied","Data":"bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd"}
Jul 14 17:05:01.990184 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.990079    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t" event={"ID":"08b8f6d0-cd27-4175-a4b5-4a75bb7b1add","Type":"ContainerDied","Data":"6c04da3a6734da7888daa2f447a9049d1eeed91d6eafabdff982e4415548bf26"}
Jul 14 17:05:01.990184 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.990099    2574 scope.go:117] "RemoveContainer" containerID="bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd"
Jul 14 17:05:01.999734 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:01.999680    2574 scope.go:117] "RemoveContainer" containerID="bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd"
Jul 14 17:05:02.000071 ip-10-0-130-193 kubenswrapper[2574]: E0714 17:05:02.000049    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd\": container with ID starting with bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd not found: ID does not exist" containerID="bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd"
Jul 14 17:05:02.000148 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:02.000085    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd"} err="failed to get container status \"bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd\": rpc error: code = NotFound desc = could not find container \"bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd\": container with ID starting with bd3f1638b2cee99df017ac38b85e3ada84757036a58d77cb9f57179b997b1afd not found: ID does not exist"
Jul 14 17:05:02.016316 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:02.016276    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"]
Jul 14 17:05:02.020709 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:02.020676    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-314eb4-5f48fbdff8-xs86t"]
Jul 14 17:05:02.756422 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:02.756384    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08b8f6d0-cd27-4175-a4b5-4a75bb7b1add" path="/var/lib/kubelet/pods/08b8f6d0-cd27-4175-a4b5-4a75bb7b1add/volumes"
Jul 14 17:05:05.699671 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.699583    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 17:05:05.825437 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825397    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-credential-socket\") pod \"7c3aa359-5153-413a-903e-c62f58769977\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") "
Jul 14 17:05:05.825437 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825433    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-envoy\") pod \"7c3aa359-5153-413a-903e-c62f58769977\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") "
Jul 14 17:05:05.825683 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825464    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3aa359-5153-413a-903e-c62f58769977-istiod-ca-cert\") pod \"7c3aa359-5153-413a-903e-c62f58769977\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") "
Jul 14 17:05:05.825683 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825583    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-certs\") pod \"7c3aa359-5153-413a-903e-c62f58769977\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") "
Jul 14 17:05:05.825802 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825748    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-socket\") pod \"7c3aa359-5153-413a-903e-c62f58769977\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") "
Jul 14 17:05:05.825870 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825827    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-istio-token\") pod \"7c3aa359-5153-413a-903e-c62f58769977\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") "
Jul 14 17:05:05.825870 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825753    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c3aa359-5153-413a-903e-c62f58769977" (UID: "7c3aa359-5153-413a-903e-c62f58769977"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:05:05.825976 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825878    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3aa359-5153-413a-903e-c62f58769977-istio-podinfo\") pod \"7c3aa359-5153-413a-903e-c62f58769977\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") "
Jul 14 17:05:05.825976 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825911    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs5rk\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-kube-api-access-vs5rk\") pod \"7c3aa359-5153-413a-903e-c62f58769977\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") "
Jul 14 17:05:05.825976 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825942    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-data\") pod \"7c3aa359-5153-413a-903e-c62f58769977\" (UID: \"7c3aa359-5153-413a-903e-c62f58769977\") "
Jul 14 17:05:05.826125 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825998    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c3aa359-5153-413a-903e-c62f58769977" (UID: "7c3aa359-5153-413a-903e-c62f58769977"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:05:05.826125 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.826050    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c3aa359-5153-413a-903e-c62f58769977-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c3aa359-5153-413a-903e-c62f58769977" (UID: "7c3aa359-5153-413a-903e-c62f58769977"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 17:05:05.826282 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.825933    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c3aa359-5153-413a-903e-c62f58769977" (UID: "7c3aa359-5153-413a-903e-c62f58769977"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:05:05.826361 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.826339    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-certs\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:05.826361 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.826357    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-workload-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:05.826463 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.826372    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-credential-socket\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:05.826463 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.826386    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3aa359-5153-413a-903e-c62f58769977-istiod-ca-cert\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:05.827018 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.826996    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c3aa359-5153-413a-903e-c62f58769977" (UID: "7c3aa359-5153-413a-903e-c62f58769977"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:05:05.828259 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.828234    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c3aa359-5153-413a-903e-c62f58769977-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c3aa359-5153-413a-903e-c62f58769977" (UID: "7c3aa359-5153-413a-903e-c62f58769977"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 17:05:05.828343 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.828261    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c3aa359-5153-413a-903e-c62f58769977" (UID: "7c3aa359-5153-413a-903e-c62f58769977"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:05:05.828454 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.828440    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c3aa359-5153-413a-903e-c62f58769977" (UID: "7c3aa359-5153-413a-903e-c62f58769977"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:05:05.828525 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.828509    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-kube-api-access-vs5rk" (OuterVolumeSpecName: "kube-api-access-vs5rk") pod "7c3aa359-5153-413a-903e-c62f58769977" (UID: "7c3aa359-5153-413a-903e-c62f58769977"). InnerVolumeSpecName "kube-api-access-vs5rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:05:05.927311 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.927268    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-istio-token\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:05.927311 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.927308    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3aa359-5153-413a-903e-c62f58769977-istio-podinfo\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:05.927311 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.927318    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs5rk\" (UniqueName: \"kubernetes.io/projected/7c3aa359-5153-413a-903e-c62f58769977-kube-api-access-vs5rk\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:05.927560 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.927327    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-data\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:05.927560 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:05.927338    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3aa359-5153-413a-903e-c62f58769977-istio-envoy\") on node \"ip-10-0-130-193.ec2.internal\" DevicePath \"\""
Jul 14 17:05:06.013847 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.013817    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c3aa359-5153-413a-903e-c62f58769977" containerID="379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856" exitCode=0
Jul 14 17:05:06.014023 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.013867    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"
Jul 14 17:05:06.014023 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.013895    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" event={"ID":"7c3aa359-5153-413a-903e-c62f58769977","Type":"ContainerDied","Data":"379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856"}
Jul 14 17:05:06.014023 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.013958    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d" event={"ID":"7c3aa359-5153-413a-903e-c62f58769977","Type":"ContainerDied","Data":"f5eb32da61538bbccec6830213ce6784267ffb43d39f5ebd7d814d0d572420ba"}
Jul 14 17:05:06.014023 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.013989    2574 scope.go:117] "RemoveContainer" containerID="379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856"
Jul 14 17:05:06.023957 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.023933    2574 scope.go:117] "RemoveContainer" containerID="91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a"
Jul 14 17:05:06.032635 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.032606    2574 scope.go:117] "RemoveContainer" containerID="379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856"
Jul 14 17:05:06.032936 ip-10-0-130-193 kubenswrapper[2574]: E0714 17:05:06.032916    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856\": container with ID starting with 379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856 not found: ID does not exist" containerID="379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856"
Jul 14 17:05:06.033011 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.032944    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856"} err="failed to get container status \"379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856\": rpc error: code = NotFound desc = could not find container \"379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856\": container with ID starting with 379f6e6b7d8bd159ffda8e6910813450f1cf7e1c5263df2e8dc90b359c8b5856 not found: ID does not exist"
Jul 14 17:05:06.033011 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.032962    2574 scope.go:117] "RemoveContainer" containerID="91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a"
Jul 14 17:05:06.033219 ip-10-0-130-193 kubenswrapper[2574]: E0714 17:05:06.033199    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a\": container with ID starting with 91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a not found: ID does not exist" containerID="91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a"
Jul 14 17:05:06.033262 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.033227    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a"} err="failed to get container status \"91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a\": rpc error: code = NotFound desc = could not find container \"91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a\": container with ID starting with 91753765a9033a2553c5614c8289240f10729bbd27f891827354f63ec702ae0a not found: ID does not exist"
Jul 14 17:05:06.039128 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.039083    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"]
Jul 14 17:05:06.050445 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.050409    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-584665-openshift-default-bb9589459-nfq5d"]
Jul 14 17:05:06.758206 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:06.758171    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c3aa359-5153-413a-903e-c62f58769977" path="/var/lib/kubelet/pods/7c3aa359-5153-413a-903e-c62f58769977/volumes"
Jul 14 17:05:07.911845 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:07.911803    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:08.069695 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:08.069659    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:08.159152 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:08.159108    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:08.379243 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:08.379213    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:08.833650 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:08.833609    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fc944b4d8-q9b9q_509d00f5-24b0-471c-9002-0e44c5b53f69/authorino/0.log"
Jul 14 17:05:13.573502 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:13.573474    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-h2tnf_9dbe4b9e-4659-411b-a2c7-4066629d71f3/manager/0.log"
Jul 14 17:05:13.831434 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:13.831348    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b45cfb7cb-q2z86_8a61db4a-80b3-4f4d-aa1c-51e4019bf939/maas-api/0.log"
Jul 14 17:05:14.296627 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:14.296594    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zcb4j_489aacb6-fad5-41d1-a9f0-d708d6084d24/server/0.log"
Jul 14 17:05:14.417819 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:14.417764    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lbzw2_9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e/manager/0.log"
Jul 14 17:05:14.796093 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:14.796063    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6f9446cf-v8jrr_8c6b761f-b2d3-40b1-bc31-fd1719822717/copy-manifests/0.log"
Jul 14 17:05:14.804174 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:14.804145    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6f9446cf-v8jrr_8c6b761f-b2d3-40b1-bc31-fd1719822717/manager/0.log"
Jul 14 17:05:14.913008 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:14.912977    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wzdl8_ca88c71f-9311-4d2a-9bb0-39091b9174a2/postgres/0.log"
Jul 14 17:05:16.276969 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:16.275711    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fc944b4d8-q9b9q_509d00f5-24b0-471c-9002-0e44c5b53f69/authorino/0.log"
Jul 14 17:05:16.400802 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:16.400749    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-khss8_dd46c44d-cc9e-459d-8c08-01d782cfe73e/manager/0.log"
Jul 14 17:05:16.513636 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:16.513595    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hmzd_111c4ad0-e4bd-4f91-868e-810b154bcbb2/manager/0.log"
Jul 14 17:05:16.635953 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:16.635868    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lmrc4_b0fdf47b-8b1d-4753-8c54-d9c425567467/kuadrant-console-plugin/0.log"
Jul 14 17:05:16.762799 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:16.762747    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2nnk8_0f5ec859-57ad-453a-9c62-e84416aab566/registry-server/0.log"
Jul 14 17:05:17.133140 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:17.133109    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xgxvl_f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f/manager/0.log"
Jul 14 17:05:17.498768 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:17.498736    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4972ls_c2792f6c-264d-449d-80a6-2600a087def3/istio-proxy/0.log"
Jul 14 17:05:17.841555 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:17.841466    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f7bf6bc6-qd8tz_adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8/kube-auth-proxy/0.log"
Jul 14 17:05:17.964171 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:17.964136    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jvbxl_b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4/istio-proxy/1.log"
Jul 14 17:05:18.088626 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:18.088586    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-w8whb_d7b857fe-eaf9-42d2-af7c-7cace5e581b3/payload-pre-processing/0.log"
Jul 14 17:05:18.667575 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:18.667524    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-89mt9_f0665603-32de-4963-b880-b62293107a8b/main/0.log"
Jul 14 17:05:18.894154 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:18.894128    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zzknm_2fc873c9-9fb0-4639-adf1-af000a7bdba6/main/0.log"
Jul 14 17:05:19.236509 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:19.236478    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-bf8fx_f8d2a12e-e7fb-470b-95d1-06d780edb3b1/main/0.log"
Jul 14 17:05:23.850617 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:23.850570    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:23.948356 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:23.948321    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log" limit=1024
Jul 14 17:05:26.759181 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:26.759149    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-drncg_c2ff6a8a-d28d-48e9-b32c-4ff902e7bf22/global-pull-secret-syncer/0.log"
Jul 14 17:05:26.856212 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:26.856183    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d5cpr_b5476361-a5d4-422f-8293-b5413c4132c6/konnectivity-agent/0.log"
Jul 14 17:05:26.948992 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:26.948960    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-193.ec2.internal_e0a654e6493db505ccfbf814b657b501/haproxy/0.log"
Jul 14 17:05:32.091220 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:32.091175    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fc944b4d8-q9b9q_509d00f5-24b0-471c-9002-0e44c5b53f69/authorino/0.log"
Jul 14 17:05:32.122541 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:32.122507    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-khss8_dd46c44d-cc9e-459d-8c08-01d782cfe73e/manager/0.log"
Jul 14 17:05:32.151322 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:32.151289    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hmzd_111c4ad0-e4bd-4f91-868e-810b154bcbb2/manager/0.log"
Jul 14 17:05:32.186885 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:32.186852    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lmrc4_b0fdf47b-8b1d-4753-8c54-d9c425567467/kuadrant-console-plugin/0.log"
Jul 14 17:05:32.247765 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:32.247737    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2nnk8_0f5ec859-57ad-453a-9c62-e84416aab566/registry-server/0.log"
Jul 14 17:05:32.532927 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:32.532891    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xgxvl_f18d3a7e-9405-4c6b-93fd-6b3a70fd7b0f/manager/0.log"
Jul 14 17:05:34.536492 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:34.536453    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bv8h_8eda014f-d28a-4baf-be04-796fa27f0426/node-exporter/0.log"
Jul 14 17:05:34.557116 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:34.557084    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bv8h_8eda014f-d28a-4baf-be04-796fa27f0426/kube-rbac-proxy/0.log"
Jul 14 17:05:34.577624 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:34.577593    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bv8h_8eda014f-d28a-4baf-be04-796fa27f0426/init-textfile/0.log"
Jul 14 17:05:36.748056 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748011    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"]
Jul 14 17:05:36.748544 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748389    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b8f6d0-cd27-4175-a4b5-4a75bb7b1add" containerName="maas-api"
Jul 14 17:05:36.748544 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748400    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b8f6d0-cd27-4175-a4b5-4a75bb7b1add" containerName="maas-api"
Jul 14 17:05:36.748544 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748410    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy"
Jul 14 17:05:36.748544 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748415    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy"
Jul 14 17:05:36.748544 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748428    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy"
Jul 14 17:05:36.748544 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748434    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy"
Jul 14 17:05:36.748544 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748496    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy"
Jul 14 17:05:36.748544 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748510    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c3aa359-5153-413a-903e-c62f58769977" containerName="istio-proxy"
Jul 14 17:05:36.748544 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.748518    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="08b8f6d0-cd27-4175-a4b5-4a75bb7b1add" containerName="maas-api"
Jul 14 17:05:36.752224 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.752203    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.755292 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.755119    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnx7p\"/\"openshift-service-ca.crt\""
Jul 14 17:05:36.755450 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.755339    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnx7p\"/\"kube-root-ca.crt\""
Jul 14 17:05:36.755520 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.755463    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jnx7p\"/\"default-dockercfg-sn9px\""
Jul 14 17:05:36.761704 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.761680    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"]
Jul 14 17:05:36.804053 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.804021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-lib-modules\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.804243 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.804077    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-sys\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.804243 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.804145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-podres\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.804243 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.804182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjkqd\" (UniqueName: \"kubernetes.io/projected/80ce80d0-fc77-46b9-85b5-a15029a2b00d-kube-api-access-pjkqd\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.804243 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.804202    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-proc\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.904895 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.904846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-lib-modules\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.905070 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.904930    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-sys\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.905070 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.904963    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-podres\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.905070 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.904983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjkqd\" (UniqueName: \"kubernetes.io/projected/80ce80d0-fc77-46b9-85b5-a15029a2b00d-kube-api-access-pjkqd\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.905070 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.905000    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-proc\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.905070 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.905022    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-sys\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.905070 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.905025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-lib-modules\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.905273 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.905080    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-proc\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.905273 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.905090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80ce80d0-fc77-46b9-85b5-a15029a2b00d-podres\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:36.913841 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:36.913770    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjkqd\" (UniqueName: \"kubernetes.io/projected/80ce80d0-fc77-46b9-85b5-a15029a2b00d-kube-api-access-pjkqd\") pod \"perf-node-gather-daemonset-6mcq7\" (UID: \"80ce80d0-fc77-46b9-85b5-a15029a2b00d\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:37.063842 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:37.063715    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:37.204213 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:37.204181    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"]
Jul 14 17:05:37.207003 ip-10-0-130-193 kubenswrapper[2574]: W0714 17:05:37.206937    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod80ce80d0_fc77_46b9_85b5_a15029a2b00d.slice/crio-0b2f386683f4de540d11c169247cda18bab2660cce6305a96028fd52abee7168 WatchSource:0}: Error finding container 0b2f386683f4de540d11c169247cda18bab2660cce6305a96028fd52abee7168: Status 404 returned error can't find the container with id 0b2f386683f4de540d11c169247cda18bab2660cce6305a96028fd52abee7168
Jul 14 17:05:38.168293 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:38.168257    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7" event={"ID":"80ce80d0-fc77-46b9-85b5-a15029a2b00d","Type":"ContainerStarted","Data":"6b99fe52e29029bb621c8de4245a6519783ea2fce22dda997986664fd435b51a"}
Jul 14 17:05:38.168721 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:38.168320    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7" event={"ID":"80ce80d0-fc77-46b9-85b5-a15029a2b00d","Type":"ContainerStarted","Data":"0b2f386683f4de540d11c169247cda18bab2660cce6305a96028fd52abee7168"}
Jul 14 17:05:38.168721 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:38.168463    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:38.186343 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:38.186285    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7" podStartSLOduration=2.186266628 podStartE2EDuration="2.186266628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:05:38.184815719 +0000 UTC m=+2371.963979646" watchObservedRunningTime="2026-07-14 17:05:38.186266628 +0000 UTC m=+2371.965430563"
Jul 14 17:05:39.532733 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:39.532701    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4bbms_03790887-ead8-4e3e-b2b5-289fafb70c7c/dns/0.log"
Jul 14 17:05:39.560378 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:39.560344    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4bbms_03790887-ead8-4e3e-b2b5-289fafb70c7c/kube-rbac-proxy/0.log"
Jul 14 17:05:39.713044 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:39.713010    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcrcf_c44440c0-557e-4b30-b53b-ac9b24668c0a/dns-node-resolver/0.log"
Jul 14 17:05:40.237178 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:40.237145    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-847bc8d77b-4vvlh_7ed2087b-3a48-43e7-acd3-7fe07d3ff751/registry/0.log"
Jul 14 17:05:40.320202 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:40.320172    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xhpsb_be2eaf0e-e134-4d45-b39e-35af2e639478/node-ca/0.log"
Jul 14 17:05:41.191556 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:41.191525    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4972ls_c2792f6c-264d-449d-80a6-2600a087def3/istio-proxy/0.log"
Jul 14 17:05:41.345509 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:41.345474    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f7bf6bc6-qd8tz_adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8/kube-auth-proxy/0.log"
Jul 14 17:05:41.376874 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:41.376839    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jvbxl_b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4/istio-proxy/0.log"
Jul 14 17:05:41.432444 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:41.432404    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jvbxl_b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4/istio-proxy/1.log"
Jul 14 17:05:41.472043 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:41.471953    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-w8whb_d7b857fe-eaf9-42d2-af7c-7cace5e581b3/payload-pre-processing/0.log"
Jul 14 17:05:42.219793 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:42.219762    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlmjp_a5daa139-10d8-4a8c-81ee-c645b18909c4/serve-healthcheck-canary/0.log"
Jul 14 17:05:42.757979 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:42.757946    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q898l_9bc128a5-b622-4c08-8f03-4996c20b2e7b/kube-rbac-proxy/0.log"
Jul 14 17:05:42.778339 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:42.778314    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q898l_9bc128a5-b622-4c08-8f03-4996c20b2e7b/exporter/0.log"
Jul 14 17:05:42.802091 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:42.802064    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q898l_9bc128a5-b622-4c08-8f03-4996c20b2e7b/extractor/0.log"
Jul 14 17:05:44.183003 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:44.182976    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-6mcq7"
Jul 14 17:05:44.940113 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:44.940079    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-h2tnf_9dbe4b9e-4659-411b-a2c7-4066629d71f3/manager/0.log"
Jul 14 17:05:45.228367 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:45.228284    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b45cfb7cb-q2z86_8a61db4a-80b3-4f4d-aa1c-51e4019bf939/maas-api/0.log"
Jul 14 17:05:45.397964 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:45.397932    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zcb4j_489aacb6-fad5-41d1-a9f0-d708d6084d24/server/0.log"
Jul 14 17:05:45.507901 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:45.507857    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lbzw2_9d87a3ef-7f8b-4b46-8bcc-78a9ecde295e/manager/0.log"
Jul 14 17:05:45.688062 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:45.688026    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6f9446cf-v8jrr_8c6b761f-b2d3-40b1-bc31-fd1719822717/manager/0.log"
Jul 14 17:05:45.718461 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:45.718430    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6f9446cf-v8jrr_8c6b761f-b2d3-40b1-bc31-fd1719822717/copy-manifests/0.log"
Jul 14 17:05:45.748100 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:45.748072    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wzdl8_ca88c71f-9311-4d2a-9bb0-39091b9174a2/postgres/0.log"
Jul 14 17:05:47.009655 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:47.009621    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4972ls_c2792f6c-264d-449d-80a6-2600a087def3/istio-proxy/0.log"
Jul 14 17:05:47.209696 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:47.209638    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f7bf6bc6-qd8tz_adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8/kube-auth-proxy/0.log"
Jul 14 17:05:47.239594 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:47.239496    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jvbxl_b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4/istio-proxy/0.log"
Jul 14 17:05:47.294902 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:47.294863    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jvbxl_b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4/istio-proxy/1.log"
Jul 14 17:05:47.332049 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:47.332018    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-w8whb_d7b857fe-eaf9-42d2-af7c-7cace5e581b3/payload-pre-processing/0.log"
Jul 14 17:05:48.672652 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:48.672611    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4972ls_c2792f6c-264d-449d-80a6-2600a087def3/istio-proxy/0.log"
Jul 14 17:05:48.808844 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:48.808721    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f7bf6bc6-qd8tz_adf4f1ca-b6cb-4c17-8f53-f1b4a9609db8/kube-auth-proxy/0.log"
Jul 14 17:05:48.830966 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:48.830926    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jvbxl_b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4/istio-proxy/0.log"
Jul 14 17:05:48.886035 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:48.886000    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jvbxl_b6cfa0a1-358a-45ad-bd92-c72b13bcbaf4/istio-proxy/1.log"
Jul 14 17:05:48.917828 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:48.917776    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-w8whb_d7b857fe-eaf9-42d2-af7c-7cace5e581b3/payload-pre-processing/0.log"
Jul 14 17:05:53.727612 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:53.727580    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ww29x_88dada86-a1bb-4b7f-9f1c-9d0166ce6c59/kube-multus-additional-cni-plugins/0.log"
Jul 14 17:05:53.747756 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:53.747721    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ww29x_88dada86-a1bb-4b7f-9f1c-9d0166ce6c59/egress-router-binary-copy/0.log"
Jul 14 17:05:53.770511 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:53.770484    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ww29x_88dada86-a1bb-4b7f-9f1c-9d0166ce6c59/cni-plugins/0.log"
Jul 14 17:05:53.790149 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:53.790117    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ww29x_88dada86-a1bb-4b7f-9f1c-9d0166ce6c59/bond-cni-plugin/0.log"
Jul 14 17:05:53.808586 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:53.808557    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ww29x_88dada86-a1bb-4b7f-9f1c-9d0166ce6c59/routeoverride-cni/0.log"
Jul 14 17:05:53.830325 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:53.830295    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ww29x_88dada86-a1bb-4b7f-9f1c-9d0166ce6c59/whereabouts-cni-bincopy/0.log"
Jul 14 17:05:53.850879 ip-10-0-130-193 kubenswrapper[2574]: I0714 17:05:53.850848    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ww29x_88dada86-a1bb-4b7f-9f1c-9d0166ce6c59/whereabouts-cni/0.log"