Jul 17 18:53:02.055913 ip-10-0-138-143 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 18:53:02.055925 ip-10-0-138-143 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 18:53:02.055932 ip-10-0-138-143 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 18:53:02.056198 ip-10-0-138-143 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 18:53:12.287920 ip-10-0-138-143 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 18:53:12.287938 ip-10-0-138-143 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 196f461aab4a41a4960a4366101bb444 --
Jul 17 18:54:46.815171 ip-10-0-138-143 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 18:54:47.200164 ip-10-0-138-143 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 18:54:47.200164 ip-10-0-138-143 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 18:54:47.200164 ip-10-0-138-143 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 18:54:47.200164 ip-10-0-138-143 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 18:54:47.200164 ip-10-0-138-143 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 18:54:47.202540 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.202476    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 18:54:47.206887 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206873    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:54:47.206936 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206889    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:54:47.206936 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206894    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:54:47.206936 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206897    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:54:47.206936 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206899    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:54:47.206936 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206902    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:54:47.206936 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206921    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:54:47.206936 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206925    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:54:47.206936 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206936    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:54:47.206936 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206940    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206942    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206945    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206948    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206950    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206953    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206956    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206958    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206961    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206965    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206968    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206971    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206974    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206977    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206979    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206982    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206985    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206988    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206991    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:54:47.207185 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206993    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206996    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.206998    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207000    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207003    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207005    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207007    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207010    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207012    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207015    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207017    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207019    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207023    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207026    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207029    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207031    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207034    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207037    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207040    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207042    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:54:47.207629 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207045    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207047    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207050    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207052    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207054    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207057    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207059    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207062    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207064    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207067    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207069    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207072    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207074    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207076    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207079    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207081    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207084    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207086    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207088    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207091    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:54:47.208120 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207093    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207096    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207098    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207101    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207104    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207107    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207111    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207115    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207118    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207121    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207124    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207127    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207131    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207135    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207138    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207141    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207143    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207146    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207148    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:54:47.208603 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207151    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207154    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207156    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207159    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207161    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207164    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207166    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207169    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207171    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207173    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207176    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.207178    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208634    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208641    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208645    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208648    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208650    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208653    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208656    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:54:47.209069 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208659    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208661    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208663    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208666    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208668    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208671    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208673    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208675    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208678    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208680    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208683    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208685    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208687    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208689    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208692    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208695    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208698    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208700    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208703    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208705    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:54:47.209534 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208707    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208710    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208712    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208715    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208717    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208720    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208722    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208724    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208727    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208729    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208731    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208734    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208737    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208739    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208741    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208744    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208746    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208749    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208751    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208753    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:54:47.210071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208756    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208759    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208761    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208765    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208768    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208771    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208774    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208777    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208779    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208782    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208784    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208787    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208789    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208791    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208794    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208796    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208798    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208801    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208804    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:54:47.210546 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208807    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208810    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208813    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208815    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208817    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208827    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208830    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208832    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208834    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208837    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208839    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208841    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208844    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208846    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208849    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208851    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208854    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208856    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208858    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:54:47.211024 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208861    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208866    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208870    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208873    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208876    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208878    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208881    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208883    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208885    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208888    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208890    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208893    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208895    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.208897    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209294    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209299    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209302    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209304    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209308    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209311    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:54:47.211475 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209314    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209317    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209320    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209322    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209324    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209327    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209330    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209332    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209335    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209337    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209340    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209342    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209344    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209348    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209351    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209354    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209356    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209359    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209378    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209382    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:54:47.211981 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209385    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209390    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209394    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209397    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209399    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209402    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209404    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209407    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209409    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209412    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209414    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209417    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209420    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209422    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209424    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209427    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209429    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209432    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209436    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:54:47.212461 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209439    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209442    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209445    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209447    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209450    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209452    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209457    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209460    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209463    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209465    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209468    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209470    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209473    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209475    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209478    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209480    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209483    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209485    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209487    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:54:47.213010 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209490    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209492    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209494    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209497    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209499    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209503    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209507    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209510    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209512    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209515    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209518    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209521    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209524    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209527    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209530    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209532    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209535    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209538    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209541    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:54:47.213474 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209545    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209547    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209550    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209552    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209556    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209558    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209561    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209563    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209566    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209568    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209570    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209573    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209575    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209577    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209580    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.209582    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209653    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209663    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209671    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209678    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209684    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 18:54:47.213931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209688    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209692    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209696    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209699    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209702    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209705    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209708    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209712    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209714    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209717    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209720    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209723    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209726    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209730    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209733    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209735    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209738    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209742    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209745    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209748    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209751    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209754    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209757    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209759    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 18:54:47.214440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209762    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209765    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209768    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209772    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209774    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209777    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209780    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209782    2558 flags.go:64] FLAG: --enable-server="true"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209786    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209790    2558 flags.go:64] FLAG: --event-burst="100"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209793    2558 flags.go:64] FLAG: --event-qps="50"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209795    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209798    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209800    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209804    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209806    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209809    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209812    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209814    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209819    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209822    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209826    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209829    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209831    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209834    2558 flags.go:64] FLAG: --feature-gates=""
Jul 17 18:54:47.215028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209842    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209845    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209848    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209851    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209854    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209857    2558 flags.go:64] FLAG: --help="false"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209860    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209863    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209865    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209868    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209871    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209875    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209878    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209880    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209883    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209886    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209889    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209892    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209895    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209897    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209900    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209916    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209919    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209922    2558 flags.go:64] FLAG: --lock-file=""
Jul 17 18:54:47.215683 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209924    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209927    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209932    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209937    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209939    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209942    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209945    2558 flags.go:64] FLAG: --logging-format="text"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209947    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209951    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209953    2558 flags.go:64] FLAG: --manifest-url=""
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209956    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209960    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209963    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209966    2558 flags.go:64] FLAG: --max-pods="110"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209969    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209972    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209975    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209977    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209980    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209983    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209985    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209992    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209995    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.209998    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 18:54:47.216276 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210001    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210004    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210009    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210012    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210015    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210018    2558 flags.go:64] FLAG: --port="10250"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210021    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210023    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eceb6fa63bec3c04"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210026    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210029    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210037    2558 flags.go:64] FLAG: --register-node="true"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210040    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210043    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210046    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210048    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210051    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210054    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210057    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210060    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210063    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210065    2558 flags.go:64] FLAG: --runonce="false"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210068    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210071    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210074    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210077    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 18:54:47.216861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210080    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210083    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210085    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210088    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210091    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210094    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210096    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210099    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210101    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210104    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210107    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210112    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210115    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210117    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210122    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210124    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210127    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210133    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210136    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210138    2558 flags.go:64] FLAG: --v="2"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210142    2558 flags.go:64] FLAG: --version="false"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210146    2558 flags.go:64] FLAG: --vmodule=""
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210149    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.210152    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 18:54:47.217485 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210260    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210264    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210267    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210270    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210272    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210275    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210277    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210280    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210282    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210285    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210288    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210290    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210293    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210295    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210297    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210300    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210302    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210305    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210308    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210310    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:54:47.218071 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210313    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210315    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210317    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210320    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210322    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210327    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210330    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210332    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210335    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210337    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210339    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210342    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210344    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210347    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210349    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210351    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210354    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210356    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210359    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210361    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:54:47.218772 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210363    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210366    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210368    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210371    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210373    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210376    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210378    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210381    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210383    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210386    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210388    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210394    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210398    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210402    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210405    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210408    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210410    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210416    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210419    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:54:47.219529 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210422    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210424    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210427    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210429    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210432    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210434    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210437    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210439    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210442    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210444    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210446    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210449    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210451    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210453    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210456    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210459    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210461    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210463    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210466    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:54:47.220002 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210468    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210472    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210476    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210478    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210481    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210483    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210486    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210488    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210491    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210493    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210495    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210501    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210504    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210506    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210509    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210511    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210514    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210516    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210519    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210522    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:54:47.220478 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.210524    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.211321    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.217391    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.217406    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.217423    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.217429    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217482    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217487    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217491    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217495    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217498    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217502    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217505    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217507    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217510    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:54:47.220964 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217512    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217515    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217517    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217521    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217525    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217528    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217531    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217534    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217537    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217539    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217542    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217546    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217549    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217552    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217555    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217557    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217560    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217563    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217566    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:54:47.221322 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217569    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217574    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217576    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217579    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217582    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217584    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217587    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217589    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217592    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217595    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217597    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217600    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217602    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217605    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217607    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217609    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217612    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217615    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217617    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217619    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:54:47.221774 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217622    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217624    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217627    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217629    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217632    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217635    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217638    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217642    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217645    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217647    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217649    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217652    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217655    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217658    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217661    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217663    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217666    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217668    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217670    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217673    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:54:47.222270 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217675    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217677    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217680    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217682    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217685    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217687    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217689    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217692    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217694    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217697    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217699    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217702    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217704    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217707    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217709    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217711    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217714    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217716    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217718    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217721    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:54:47.222771 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217723    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217726    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217728    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217730    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217733    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217736    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217738    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217741    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217743    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217746    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217748    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.217753    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217864    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217869    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217872    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:54:47.223255 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217875    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217878    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217881    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217884    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217888    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217891    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217893    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217896    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217898    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217900    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217925    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217928    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217931    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217933    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217935    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217938    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217940    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217942    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217945    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:54:47.223615 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217947    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217949    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217952    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217955    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217958    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217960    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217963    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217966    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217968    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217970    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217973    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217975    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217977    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217980    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217982    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217985    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217988    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217990    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217992    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217995    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:54:47.224176 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217997    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.217999    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218002    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218004    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218007    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218009    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218011    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218014    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218016    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218018    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218021    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218023    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218025    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218028    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218030    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218033    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218035    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218038    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218040    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218043    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:54:47.224656 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218045    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218048    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218050    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218053    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218055    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218057    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218059    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218062    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218064    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218066    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218069    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218071    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218074    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218076    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218079    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218083    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218086    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218089    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218092    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218094    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:54:47.225146 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218097    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218100    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218103    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218106    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218110    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218112    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218115    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218118    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218121    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218123    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218126    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218128    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218131    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218134    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218136    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218139    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:54:47.225622 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:47.218141    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:54:47.226018 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.218146    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 18:54:47.226018 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.219042    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 18:54:47.226018 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.221214    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 18:54:47.226018 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.223024    2558 server.go:1019] "Starting client certificate rotation"
Jul 17 18:54:47.226018 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.223118    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 18:54:47.226018 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.223147    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 18:54:47.226018 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.225429    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 18:54:47.226638 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.226617    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 18:54:47.238160 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.238143    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 17 18:54:47.241870 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.241850    2558 log.go:25] "Validated CRI v1 image API"
Jul 17 18:54:47.242676 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.242657    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 18:54:47.247787 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.247770    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d143fd2e-9316-4074-874c-68145b8e2d7f:/dev/nvme0n1p3 fcd672ed-ea32-4453-9455-582b9f8b70b3:/dev/nvme0n1p4]
Jul 17 18:54:47.247839 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.247786    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 18:54:47.254538 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.254428    2558 manager.go:216] Machine: {Timestamp:2026-07-17 18:54:47.25188957 +0000 UTC m=+0.323336688 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099918 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d699ce3d8ba5fc00ac194fb4bec8e SystemUUID:ec2d699c-e3d8-ba5f-c00a-c194fb4bec8e BootID:196f461a-ab4a-41a4-960a-4366101bb444 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e9:37:e4:55:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e9:37:e4:55:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:c9:9d:d2:7b:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 18:54:47.254538 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.254527    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 18:54:47.254655 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.254607    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 18:54:47.256069 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.256053    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 18:54:47.257415 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.257393    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 18:54:47.257564 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.257420    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 18:54:47.258155 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.258144    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 18:54:47.258188 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.258158    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 18:54:47.258188 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.258165    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 18:54:47.258993 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.258982    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 18:54:47.260151 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.260141    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 18:54:47.263082 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.263071    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 18:54:47.263247 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.263237    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 18:54:47.263293 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.263273    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 18:54:47.263293 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.263288    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 18:54:47.263362 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.263301    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 18:54:47.263362 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.263313    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 17 18:54:47.263362 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.263321    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 18:54:47.263732 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.263717    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 18:54:47.263777 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.263765    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 18:54:47.266959 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.266940    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 18:54:47.268664 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.268652    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 18:54:47.268717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.268682    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 18:54:47.269618 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269605    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 18:54:47.269618 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269622    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269628    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269633    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269642    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269647    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269655    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269660    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269666    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269671    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269679    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 18:54:47.269717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.269684    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 18:54:47.270302 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.270293    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 18:54:47.270302 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.270302    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 18:54:47.273577 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.273562    2558 server.go:1268] "Started kubelet"
Jul 17 18:54:47.273674 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.273647    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 18:54:47.273730 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.273643    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 18:54:47.273793 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.273746    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 18:54:47.274296 ip-10-0-138-143 systemd[1]: Started Kubernetes Kubelet.
Jul 17 18:54:47.275414 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.275401    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 18:54:47.275741 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.275725    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 18:54:47.276021 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.275997    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 18:54:47.276116 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.276031    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 18:54:47.276116 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.276070    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 18:54:47.278728 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.278698    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 18:54:47.281390 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.281361    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 18:54:47.281390 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.281362    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 18:54:47.281518 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.280431    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-143.ec2.internal.18c328928d854b58  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-143.ec2.internal,UID:ip-10-0-138-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-143.ec2.internal,},FirstTimestamp:2026-07-17 18:54:47.273507672 +0000 UTC m=+0.344954790,LastTimestamp:2026-07-17 18:54:47.273507672 +0000 UTC m=+0.344954790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-143.ec2.internal,}"
Jul 17 18:54:47.281518 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.281484    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:47.282129 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.282114    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 18:54:47.282208 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.282132    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 18:54:47.282208 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.282114    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 18:54:47.282317 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.282270    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 18:54:47.282317 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.282278    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 18:54:47.282432 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.282407    2558 factory.go:55] Registering systemd factory
Jul 17 18:54:47.282486 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.282438    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 17 18:54:47.283470 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.283450    2558 factory.go:153] Registering CRI-O factory
Jul 17 18:54:47.283470 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.283471    2558 factory.go:223] Registration of the crio container factory successfully
Jul 17 18:54:47.283608 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.283526    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 18:54:47.283608 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.283550    2558 factory.go:103] Registering Raw factory
Jul 17 18:54:47.283608 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.283563    2558 manager.go:1196] Started watching for new ooms in manager
Jul 17 18:54:47.284294 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.284275    2558 manager.go:349] Starting recovery of all containers
Jul 17 18:54:47.288619 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.288592    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 18:54:47.288721 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.288699    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 18:54:47.290986 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.290954    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 18:54:47.296591 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.296557    2558 manager.go:354] Recovery completed
Jul 17 18:54:47.298976 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.298896    2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 17 18:54:47.302002 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.301990    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:54:47.303731 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.303717    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:54:47.303782 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.303745    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:54:47.303782 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.303758    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:54:47.304219 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.304206    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 18:54:47.304219 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.304217    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 18:54:47.304315 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.304221    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:54:47.304315 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.304231    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 18:54:47.305358 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.305347    2558 policy_none.go:49] "None policy: Start"
Jul 17 18:54:47.305398 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.305361    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 18:54:47.305398 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.305371    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 18:54:47.305780 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.305710    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-143.ec2.internal.18c328928f527813  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-143.ec2.internal,UID:ip-10-0-138-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-143.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-143.ec2.internal,},FirstTimestamp:2026-07-17 18:54:47.303731219 +0000 UTC m=+0.375178336,LastTimestamp:2026-07-17 18:54:47.303731219 +0000 UTC m=+0.375178336,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-143.ec2.internal,}"
Jul 17 18:54:47.305897 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.305883    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:54:47.305968 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.305926    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:54:47.305968 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.305944    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:54:47.306472 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.306459    2558 policy_none.go:47] "Start"
Jul 17 18:54:47.316775 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.316626    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-143.ec2.internal.18c328928f52cb90  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-143.ec2.internal,UID:ip-10-0-138-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-143.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-143.ec2.internal,},FirstTimestamp:2026-07-17 18:54:47.303752592 +0000 UTC m=+0.375199712,LastTimestamp:2026-07-17 18:54:47.303752592 +0000 UTC m=+0.375199712,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-143.ec2.internal,}"
Jul 17 18:54:47.320578 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.320559    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sr44p"
Jul 17 18:54:47.327242 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.327227    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sr44p"
Jul 17 18:54:47.328050 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.327950    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-143.ec2.internal.18c328928f52f1cf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-143.ec2.internal,UID:ip-10-0-138-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-143.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-143.ec2.internal,},FirstTimestamp:2026-07-17 18:54:47.303762383 +0000 UTC m=+0.375209500,LastTimestamp:2026-07-17 18:54:47.303762383 +0000 UTC m=+0.375209500,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-143.ec2.internal,}"
Jul 17 18:54:47.336495 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.336476    2558 manager.go:337] "Starting Device Plugin manager"
Jul 17 18:54:47.350326 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.336507    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 18:54:47.350326 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.336517    2558 server.go:87] "Starting device plugin registration server"
Jul 17 18:54:47.350326 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.336720    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 18:54:47.350326 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.336729    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 18:54:47.350326 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.336837    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 18:54:47.350326 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.336939    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 18:54:47.350326 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.336952    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 18:54:47.350326 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.337379    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 18:54:47.350326 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.337417    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:47.377919 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.377889    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 18:54:47.378013 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.377934    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 18:54:47.378013 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.377952    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 18:54:47.378013 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.377979    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 18:54:47.380290 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.380270    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:54:47.437048 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.437020    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:54:47.438820 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.438802    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:54:47.438896 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.438835    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:54:47.438896 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.438851    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:54:47.438896 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.438893    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.449034 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.449020    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.449094 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.449040    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-143.ec2.internal\": node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:47.473394 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.473343    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:47.478433 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.478418    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"]
Jul 17 18:54:47.478480 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.478470    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:54:47.479178 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.479166    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:54:47.479257 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.479196    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:54:47.479257 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.479212    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:54:47.480499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.480485    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:54:47.480635 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.480622    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.480678 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.480648    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:54:47.481153 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.481140    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:54:47.481153 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.481151    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:54:47.481251 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.481179    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:54:47.481251 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.481192    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:54:47.481312 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.481179    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:54:47.481347 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.481332    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:54:47.482364 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.482347    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.482444 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.482385    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:54:47.482995 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.482977    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.483077 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.483013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.483077 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.483037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b627e4843adfbd64039515f41cb64e53-config\") pod \"kube-apiserver-proxy-ip-10-0-138-143.ec2.internal\" (UID: \"b627e4843adfbd64039515f41cb64e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.483077 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.483046    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:54:47.483185 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.483089    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:54:47.483185 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.483100    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:54:47.497421 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.497400    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-143.ec2.internal\" not found" node="ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.501782 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.501768    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-143.ec2.internal\" not found" node="ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.573795 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.573774    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:47.584141 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.584122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.584198 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.584147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b627e4843adfbd64039515f41cb64e53-config\") pod \"kube-apiserver-proxy-ip-10-0-138-143.ec2.internal\" (UID: \"b627e4843adfbd64039515f41cb64e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.584198 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.584162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.584293 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.584209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.584293 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.584220    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.584293 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.584263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b627e4843adfbd64039515f41cb64e53-config\") pod \"kube-apiserver-proxy-ip-10-0-138-143.ec2.internal\" (UID: \"b627e4843adfbd64039515f41cb64e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.674300 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.674269    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:47.775014 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.774965    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:47.800498 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.800477    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.804212 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:47.804129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:47.875740 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.875715    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:47.976280 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:47.976258    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:48.076782 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:48.076733    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:48.177285 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:48.177259    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 17 18:54:48.221731 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.221708    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 18:54:48.222173 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.221826    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 18:54:48.271808 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.271786    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:54:48.282134 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.282114    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:48.282216 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.282138    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 18:54:48.293064 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.293047    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 18:54:48.296237 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.296225    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 18:54:48.297968 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.297956    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 17 18:54:48.307087 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.307076    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 18:54:48.315152 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.315139    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vnrq8"
Jul 17 18:54:48.324208 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.324194    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vnrq8"
Jul 17 18:54:48.331529 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.331472    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 18:49:48 +0000 UTC" deadline="2028-04-03 02:04:53.753634954 +0000 UTC"
Jul 17 18:54:48.331529 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.331504    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15007h10m5.422133378s"
Jul 17 18:54:48.410343 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.410325    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:54:48.530958 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:48.530926    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb627e4843adfbd64039515f41cb64e53.slice/crio-fe55c07a54dfd40b0acf0dd59381a4da9402a715ccafd05926712bae2dc13e91 WatchSource:0}: Error finding container fe55c07a54dfd40b0acf0dd59381a4da9402a715ccafd05926712bae2dc13e91: Status 404 returned error can't find the container with id fe55c07a54dfd40b0acf0dd59381a4da9402a715ccafd05926712bae2dc13e91
Jul 17 18:54:48.531468 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:48.531443    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1887ae439b2a3b9cf7ae9dd23a2eb4c4.slice/crio-5c935ae25d80079a15c5d09ecc81c99342476a93b78238c1e2e5a93f862fdc53 WatchSource:0}: Error finding container 5c935ae25d80079a15c5d09ecc81c99342476a93b78238c1e2e5a93f862fdc53: Status 404 returned error can't find the container with id 5c935ae25d80079a15c5d09ecc81c99342476a93b78238c1e2e5a93f862fdc53
Jul 17 18:54:48.538287 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.538272    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:54:48.815306 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:48.815243    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:54:49.264654 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.264579    2558 apiserver.go:52] "Watching apiserver"
Jul 17 18:54:49.273543 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.273521    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 18:54:49.275138 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.275113    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-hwqs5","kube-system/konnectivity-agent-27zjz","openshift-cluster-node-tuning-operator/tuned-mlhgm","openshift-image-registry/node-ca-4s9r8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal","openshift-multus/multus-additional-cni-plugins-2j289","openshift-ovn-kubernetes/ovnkube-node-n2cbz","kube-system/global-pull-secret-syncer-h9wdv","kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p","openshift-dns/node-resolver-rxt25","openshift-multus/multus-pxqtj","openshift-multus/network-metrics-daemon-8xrbc","openshift-network-diagnostics/network-check-target-jn5nj"]
Jul 17 18:54:49.276524 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.276502    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:49.278375 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.278348    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:49.279346 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.279315    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 18:54:49.279440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.279400    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 18:54:49.279500 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.279440    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dfwq7\""
Jul 17 18:54:49.279500 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.279324    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 18:54:49.279500 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.279494    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 18:54:49.279616 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.279315    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 18:54:49.279711 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.279694    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 18:54:49.280293 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.279939    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:49.280901 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.280887    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 18:54:49.281230 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.281212    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:49.282168 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.282148    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-282dl\""
Jul 17 18:54:49.282260 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.282193    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 18:54:49.282329 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.282307    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wjcjh\""
Jul 17 18:54:49.282697 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.282663    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:49.283083 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.283060    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 18:54:49.283174 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.283092    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:54:49.283442 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.283421    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 18:54:49.283503 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.283464    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 18:54:49.283662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.283648    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nqqts\""
Jul 17 18:54:49.283771 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.283757    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:49.284017 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:49.283820    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:54:49.285116 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.285086    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:49.286350 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.286333    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 18:54:49.286613 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.286595    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:54:49.286705 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.286602    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 18:54:49.286705 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.286618    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p2m2d\""
Jul 17 18:54:49.287296 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.286980    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:54:49.287296 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.287042    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 18:54:49.288397 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.288381    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:49.289664 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.289644    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:49.291117 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.291096    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:49.291272 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:49.291249    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:54:49.292522 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:49.292502    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 18:54:50.624880 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.624857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4qjq\" (UniqueName: \"kubernetes.io/projected/76ee2974-73ae-4179-b6af-4e9e62fbd957-kube-api-access-b4qjq\") pod \"iptables-alerter-hwqs5\" (UID: \"76ee2974-73ae-4179-b6af-4e9e62fbd957\") " pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.624949 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.624901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0afd6108-c5dc-4376-ad7c-a8ed05fb69ac-tmp-dir\") pod \"node-resolver-rxt25\" (UID: \"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac\") " pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.624949 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.624932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-sys\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.625014 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.624955    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-var-lib-kubelet\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.625014 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.624985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a50c790-77cd-4268-b02a-9f0f31e68919-tmp\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.625110 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.625014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6mzg\" (UniqueName: \"kubernetes.io/projected/e418ccff-ee04-4dad-bbd2-719e05a7f03d-kube-api-access-x6mzg\") pod \"node-ca-4s9r8\" (UID: \"e418ccff-ee04-4dad-bbd2-719e05a7f03d\") " pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.625110 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.625045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76ee2974-73ae-4179-b6af-4e9e62fbd957-iptables-alerter-script\") pod \"iptables-alerter-hwqs5\" (UID: \"76ee2974-73ae-4179-b6af-4e9e62fbd957\") " pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.625110 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.625074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-etc-openvswitch\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.625197 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.625109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-run-ovn\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.625197 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.625141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-log-socket\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.625197 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.625178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-systemd-units\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.625282 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.625234    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-var-lib-openvswitch\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.626146 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.626127    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:50.626226 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:50.626205    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.626872    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.627003    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.627138    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cn88j\""
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.627301    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.627385    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.627478    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.627485    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.627564    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.627883    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 18:54:50.628052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.627964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-cni-netd\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlwrf\" (UniqueName: \"kubernetes.io/projected/1d18f624-cf3c-4582-8e2a-f865c68b0168-kube-api-access-qlwrf\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-tuned\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-node-log\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628341    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-cni-bin\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628378    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d18f624-cf3c-4582-8e2a-f865c68b0168-env-overrides\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-sysconfig\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628429    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-kubernetes\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-sysctl-conf\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.628499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-lib-modules\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628510    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4jkr\" (UniqueName: \"kubernetes.io/projected/7a50c790-77cd-4268-b02a-9f0f31e68919-kube-api-access-t4jkr\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e418ccff-ee04-4dad-bbd2-719e05a7f03d-serviceca\") pod \"node-ca-4s9r8\" (UID: \"e418ccff-ee04-4dad-bbd2-719e05a7f03d\") " pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628562    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ckbw4\""
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628560    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d18f624-cf3c-4582-8e2a-f865c68b0168-ovnkube-script-lib\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95fnv\" (UniqueName: \"kubernetes.io/projected/0afd6108-c5dc-4376-ad7c-a8ed05fb69ac-kube-api-access-95fnv\") pod \"node-resolver-rxt25\" (UID: \"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac\") " pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-modprobe-d\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628804    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sq5d2\""
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-sysctl-d\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-run\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e418ccff-ee04-4dad-bbd2-719e05a7f03d-host\") pod \"node-ca-4s9r8\" (UID: \"e418ccff-ee04-4dad-bbd2-719e05a7f03d\") " pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.628975 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-kubelet\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.628973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-run-netns\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d18f624-cf3c-4582-8e2a-f865c68b0168-ovn-node-metrics-cert\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629055    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7994l\""
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629080    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-systemd\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-run-systemd\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-run-openvswitch\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629202    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-run-ovn-kubernetes\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629253    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0afd6108-c5dc-4376-ad7c-a8ed05fb69ac-hosts-file\") pod \"node-resolver-rxt25\" (UID: \"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac\") " pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-host\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.629476 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76ee2974-73ae-4179-b6af-4e9e62fbd957-host-slash\") pod \"iptables-alerter-hwqs5\" (UID: \"76ee2974-73ae-4179-b6af-4e9e62fbd957\") " pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.629999 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629479    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-slash\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.629999 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.629515    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d18f624-cf3c-4582-8e2a-f865c68b0168-ovnkube-config\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.656395 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.656356    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:49:49 +0000 UTC" deadline="2028-03-13 07:40:01.661772113 +0000 UTC"
Jul 17 18:54:50.656395 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.656395    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14508h45m11.005379536s"
Jul 17 18:54:50.714000 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.713279    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" event={"ID":"1887ae439b2a3b9cf7ae9dd23a2eb4c4","Type":"ContainerStarted","Data":"5c935ae25d80079a15c5d09ecc81c99342476a93b78238c1e2e5a93f862fdc53"}
Jul 17 18:54:50.714000 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.713846    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 18:54:50.714544 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.714520    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal" event={"ID":"b627e4843adfbd64039515f41cb64e53","Type":"ContainerStarted","Data":"fe55c07a54dfd40b0acf0dd59381a4da9402a715ccafd05926712bae2dc13e91"}
Jul 17 18:54:50.730284 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7767ae00-af27-49e0-97bd-c67d3b3bbf32-agent-certs\") pod \"konnectivity-agent-27zjz\" (UID: \"7767ae00-af27-49e0-97bd-c67d3b3bbf32\") " pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:54:50.730390 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7767ae00-af27-49e0-97bd-c67d3b3bbf32-konnectivity-ca\") pod \"konnectivity-agent-27zjz\" (UID: \"7767ae00-af27-49e0-97bd-c67d3b3bbf32\") " pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:54:50.730390 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.730390 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730322    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.730390 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-socket-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.730390 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-sys-fs\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-sys\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6mzg\" (UniqueName: \"kubernetes.io/projected/e418ccff-ee04-4dad-bbd2-719e05a7f03d-kube-api-access-x6mzg\") pod \"node-ca-4s9r8\" (UID: \"e418ccff-ee04-4dad-bbd2-719e05a7f03d\") " pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730469    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-etc-openvswitch\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730484    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-log-socket\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-sys\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-cni-netd\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-kubelet-config\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-log-socket\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-systemd-units\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-etc-openvswitch\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.730586 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-node-log\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730637    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-cni-netd\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730647    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-node-log\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-cni-bin\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-cni-dir\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730694    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-systemd-units\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-os-release\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-sysconfig\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-cni-bin\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-sysctl-conf\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-lib-modules\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730835    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-sysconfig\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d18f624-cf3c-4582-8e2a-f865c68b0168-ovnkube-script-lib\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730874    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-etc-kubernetes\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730916    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-lib-modules\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95fnv\" (UniqueName: \"kubernetes.io/projected/0afd6108-c5dc-4376-ad7c-a8ed05fb69ac-kube-api-access-95fnv\") pod \"node-resolver-rxt25\" (UID: \"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac\") " pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.731066 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730941    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-sysctl-conf\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.730961    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-sysctl-d\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e418ccff-ee04-4dad-bbd2-719e05a7f03d-host\") pod \"node-ca-4s9r8\" (UID: \"e418ccff-ee04-4dad-bbd2-719e05a7f03d\") " pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d18f624-cf3c-4582-8e2a-f865c68b0168-ovn-node-metrics-cert\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731095    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-systemd\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e418ccff-ee04-4dad-bbd2-719e05a7f03d-host\") pod \"node-ca-4s9r8\" (UID: \"e418ccff-ee04-4dad-bbd2-719e05a7f03d\") " pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-sysctl-d\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-system-cni-dir\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-systemd\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-etc-selinux\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-host\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731386    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d18f624-cf3c-4582-8e2a-f865c68b0168-ovnkube-config\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-hostroot\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731426    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-run-multus-certs\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.731903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d18f624-cf3c-4582-8e2a-f865c68b0168-ovnkube-script-lib\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4qjq\" (UniqueName: \"kubernetes.io/projected/76ee2974-73ae-4179-b6af-4e9e62fbd957-kube-api-access-b4qjq\") pod \"iptables-alerter-hwqs5\" (UID: \"76ee2974-73ae-4179-b6af-4e9e62fbd957\") " pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-host\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-dbus\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-var-lib-kubelet\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731616    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kndn6\" (UniqueName: \"kubernetes.io/projected/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-kube-api-access-kndn6\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-var-lib-kubelet\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-var-lib-kubelet\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731720    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a50c790-77cd-4268-b02a-9f0f31e68919-tmp\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76ee2974-73ae-4179-b6af-4e9e62fbd957-iptables-alerter-script\") pod \"iptables-alerter-hwqs5\" (UID: \"76ee2974-73ae-4179-b6af-4e9e62fbd957\") " pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731788    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-run-ovn\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlwrf\" (UniqueName: \"kubernetes.io/projected/1d18f624-cf3c-4582-8e2a-f865c68b0168-kube-api-access-qlwrf\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d18f624-cf3c-4582-8e2a-f865c68b0168-ovnkube-config\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjj8j\" (UniqueName: \"kubernetes.io/projected/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-kube-api-access-jjj8j\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-socket-dir-parent\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731884    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-run-ovn\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-run-netns\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.732796 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-var-lib-openvswitch\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-registration-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.731984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-var-lib-cni-multus\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-tuned\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732014    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-var-lib-openvswitch\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d18f624-cf3c-4582-8e2a-f865c68b0168-env-overrides\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732103    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trdz\" (UniqueName: \"kubernetes.io/projected/dc317da8-729e-4b00-bc8e-8694b867da64-kube-api-access-2trdz\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-cnibin\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-daemon-config\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-cnibin\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-kubernetes\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732220    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4jkr\" (UniqueName: \"kubernetes.io/projected/7a50c790-77cd-4268-b02a-9f0f31e68919-kube-api-access-t4jkr\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e418ccff-ee04-4dad-bbd2-719e05a7f03d-serviceca\") pod \"node-ca-4s9r8\" (UID: \"e418ccff-ee04-4dad-bbd2-719e05a7f03d\") " pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8w7m\" (UniqueName: \"kubernetes.io/projected/b6385e42-0b9c-42b3-9cca-636482e1238d-kube-api-access-q8w7m\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732284    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-modprobe-d\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-run\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-kubelet\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.733698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732363    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-run-netns\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732366    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76ee2974-73ae-4179-b6af-4e9e62fbd957-iptables-alerter-script\") pod \"iptables-alerter-hwqs5\" (UID: \"76ee2974-73ae-4179-b6af-4e9e62fbd957\") " pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732464    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-kubernetes\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-system-cni-dir\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-modprobe-d\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-cni-binary-copy\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-run-netns\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-run-k8s-cni-cncf-io\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732849    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d18f624-cf3c-4582-8e2a-f865c68b0168-env-overrides\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-run-systemd\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-run-openvswitch\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-run-systemd\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732920    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-run-ovn-kubernetes\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-run-openvswitch\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-run-ovn-kubernetes\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.734467 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.732992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-os-release\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733015    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733153    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e418ccff-ee04-4dad-bbd2-719e05a7f03d-serviceca\") pod \"node-ca-4s9r8\" (UID: \"e418ccff-ee04-4dad-bbd2-719e05a7f03d\") " pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733225    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-kubelet\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-device-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a50c790-77cd-4268-b02a-9f0f31e68919-run\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733560    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-conf-dir\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0afd6108-c5dc-4376-ad7c-a8ed05fb69ac-hosts-file\") pod \"node-resolver-rxt25\" (UID: \"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac\") " pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733633    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76ee2974-73ae-4179-b6af-4e9e62fbd957-host-slash\") pod \"iptables-alerter-hwqs5\" (UID: \"76ee2974-73ae-4179-b6af-4e9e62fbd957\") " pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733658    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-slash\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-var-lib-cni-bin\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d18f624-cf3c-4582-8e2a-f865c68b0168-host-slash\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76ee2974-73ae-4179-b6af-4e9e62fbd957-host-slash\") pod \"iptables-alerter-hwqs5\" (UID: \"76ee2974-73ae-4179-b6af-4e9e62fbd957\") " pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733683    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0afd6108-c5dc-4376-ad7c-a8ed05fb69ac-hosts-file\") pod \"node-resolver-rxt25\" (UID: \"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac\") " pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.733747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0afd6108-c5dc-4376-ad7c-a8ed05fb69ac-tmp-dir\") pod \"node-resolver-rxt25\" (UID: \"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac\") " pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.735288 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.734061    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0afd6108-c5dc-4376-ad7c-a8ed05fb69ac-tmp-dir\") pod \"node-resolver-rxt25\" (UID: \"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac\") " pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.735833 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.734875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a50c790-77cd-4268-b02a-9f0f31e68919-tmp\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.735833 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.734893    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d18f624-cf3c-4582-8e2a-f865c68b0168-ovn-node-metrics-cert\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.735833 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.734905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a50c790-77cd-4268-b02a-9f0f31e68919-etc-tuned\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.741490 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.741455    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95fnv\" (UniqueName: \"kubernetes.io/projected/0afd6108-c5dc-4376-ad7c-a8ed05fb69ac-kube-api-access-95fnv\") pod \"node-resolver-rxt25\" (UID: \"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac\") " pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.742027 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.741982    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6mzg\" (UniqueName: \"kubernetes.io/projected/e418ccff-ee04-4dad-bbd2-719e05a7f03d-kube-api-access-x6mzg\") pod \"node-ca-4s9r8\" (UID: \"e418ccff-ee04-4dad-bbd2-719e05a7f03d\") " pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.742167 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.742120    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlwrf\" (UniqueName: \"kubernetes.io/projected/1d18f624-cf3c-4582-8e2a-f865c68b0168-kube-api-access-qlwrf\") pod \"ovnkube-node-n2cbz\" (UID: \"1d18f624-cf3c-4582-8e2a-f865c68b0168\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.742231 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.742190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4qjq\" (UniqueName: \"kubernetes.io/projected/76ee2974-73ae-4179-b6af-4e9e62fbd957-kube-api-access-b4qjq\") pod \"iptables-alerter-hwqs5\" (UID: \"76ee2974-73ae-4179-b6af-4e9e62fbd957\") " pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.742286 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.742265    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4jkr\" (UniqueName: \"kubernetes.io/projected/7a50c790-77cd-4268-b02a-9f0f31e68919-kube-api-access-t4jkr\") pod \"tuned-mlhgm\" (UID: \"7a50c790-77cd-4268-b02a-9f0f31e68919\") " pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.834269 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834240    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-socket-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.834269 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-sys-fs\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-kubelet-config\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-cni-dir\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834330    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-os-release\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834354    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-sys-fs\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-kubelet-config\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-etc-kubernetes\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834418    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-socket-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-os-release\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834465    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-cni-dir\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-system-cni-dir\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834467    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-etc-kubernetes\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834488    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-system-cni-dir\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-etc-selinux\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:50.834536    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-hostroot\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834550    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-run-multus-certs\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834585    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-hostroot\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834596    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-run-multus-certs\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834632    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-dbus\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834646    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-etc-selinux\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:50.834677    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs podName:dc317da8-729e-4b00-bc8e-8694b867da64 nodeName:}" failed. No retries permitted until 2026-07-17 18:54:51.334642293 +0000 UTC m=+3.075395095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs") pod "network-metrics-daemon-8xrbc" (UID: "dc317da8-729e-4b00-bc8e-8694b867da64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:50.834931 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834702    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-var-lib-kubelet\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834723    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-var-lib-kubelet\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-dbus\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kndn6\" (UniqueName: \"kubernetes.io/projected/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-kube-api-access-kndn6\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjj8j\" (UniqueName: \"kubernetes.io/projected/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-kube-api-access-jjj8j\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834856    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-socket-dir-parent\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-run-netns\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-socket-dir-parent\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.834918    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-run-netns\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-registration-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835028    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-var-lib-cni-multus\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2trdz\" (UniqueName: \"kubernetes.io/projected/dc317da8-729e-4b00-bc8e-8694b867da64-kube-api-access-2trdz\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-cnibin\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-daemon-config\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835103    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-var-lib-cni-multus\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-registration-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-cnibin\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.835662 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835154    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8w7m\" (UniqueName: \"kubernetes.io/projected/b6385e42-0b9c-42b3-9cca-636482e1238d-kube-api-access-q8w7m\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-system-cni-dir\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835205    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-cnibin\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835214    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-cni-binary-copy\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-run-k8s-cni-cncf-io\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-system-cni-dir\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:50.835259    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-cnibin\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-os-release\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835280    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-run-k8s-cni-cncf-io\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:50.835311    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret podName:f81b37e7-4f8b-42e9-8af1-187f5d26cd27 nodeName:}" failed. No retries permitted until 2026-07-17 18:54:51.335298063 +0000 UTC m=+3.076050850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret") pod "global-pull-secret-syncer-h9wdv" (UID: "f81b37e7-4f8b-42e9-8af1-187f5d26cd27") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835322    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-os-release\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-device-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-conf-dir\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-var-lib-cni-bin\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6385e42-0b9c-42b3-9cca-636482e1238d-device-dir\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-host-var-lib-cni-bin\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835429    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-conf-dir\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835448    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835475    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7767ae00-af27-49e0-97bd-c67d3b3bbf32-agent-certs\") pod \"konnectivity-agent-27zjz\" (UID: \"7767ae00-af27-49e0-97bd-c67d3b3bbf32\") " pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7767ae00-af27-49e0-97bd-c67d3b3bbf32-konnectivity-ca\") pod \"konnectivity-agent-27zjz\" (UID: \"7767ae00-af27-49e0-97bd-c67d3b3bbf32\") " pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835532    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-cni-binary-copy\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835918    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-multus-daemon-config\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.835986    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.836169    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.836176    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.836819 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.836247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7767ae00-af27-49e0-97bd-c67d3b3bbf32-konnectivity-ca\") pod \"konnectivity-agent-27zjz\" (UID: \"7767ae00-af27-49e0-97bd-c67d3b3bbf32\") " pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:54:50.837860 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.837845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7767ae00-af27-49e0-97bd-c67d3b3bbf32-agent-certs\") pod \"konnectivity-agent-27zjz\" (UID: \"7767ae00-af27-49e0-97bd-c67d3b3bbf32\") " pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:54:50.846654 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.846592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kndn6\" (UniqueName: \"kubernetes.io/projected/c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8-kube-api-access-kndn6\") pod \"multus-pxqtj\" (UID: \"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8\") " pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.848441 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.848238    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trdz\" (UniqueName: \"kubernetes.io/projected/dc317da8-729e-4b00-bc8e-8694b867da64-kube-api-access-2trdz\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:50.849323 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:50.849302    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:54:50.849413 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:50.849329    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:54:50.849413 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:50.849344    2558 projected.go:196] Error preparing data for projected volume kube-api-access-www2d for pod openshift-network-diagnostics/network-check-target-jn5nj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:50.849413 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:50.849399    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d podName:c429a0ee-0a90-408d-9932-8093b987145d nodeName:}" failed. No retries permitted until 2026-07-17 18:54:51.349382571 +0000 UTC m=+3.090135363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-www2d" (UniqueName: "kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d") pod "network-check-target-jn5nj" (UID: "c429a0ee-0a90-408d-9932-8093b987145d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:50.850323 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.850302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjj8j\" (UniqueName: \"kubernetes.io/projected/4aed984b-c4cb-4681-81e1-42a4cb1b7f6a-kube-api-access-jjj8j\") pod \"multus-additional-cni-plugins-2j289\" (UID: \"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a\") " pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.850423 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.850334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8w7m\" (UniqueName: \"kubernetes.io/projected/b6385e42-0b9c-42b3-9cca-636482e1238d-kube-api-access-q8w7m\") pod \"aws-ebs-csi-driver-node-vdg9p\" (UID: \"b6385e42-0b9c-42b3-9cca-636482e1238d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.920491 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.920465    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:54:50.928345 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.928329    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rxt25"
Jul 17 18:54:50.928977 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:50.928948    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d18f624_cf3c_4582_8e2a_f865c68b0168.slice/crio-1a0b6aabf411d58bd538146c9c66f6b73169b3e0bbff7a5c266621a29851ef38 WatchSource:0}: Error finding container 1a0b6aabf411d58bd538146c9c66f6b73169b3e0bbff7a5c266621a29851ef38: Status 404 returned error can't find the container with id 1a0b6aabf411d58bd538146c9c66f6b73169b3e0bbff7a5c266621a29851ef38
Jul 17 18:54:50.936593 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:50.936571    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afd6108_c5dc_4376_ad7c_a8ed05fb69ac.slice/crio-7bb2ab061a7a06ef520137b758d7acf85fde7fc022038e1a7381b545dec84b4c WatchSource:0}: Error finding container 7bb2ab061a7a06ef520137b758d7acf85fde7fc022038e1a7381b545dec84b4c: Status 404 returned error can't find the container with id 7bb2ab061a7a06ef520137b758d7acf85fde7fc022038e1a7381b545dec84b4c
Jul 17 18:54:50.937888 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.937864    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mlhgm"
Jul 17 18:54:50.942729 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.942586    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4s9r8"
Jul 17 18:54:50.944515 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:50.944495    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a50c790_77cd_4268_b02a_9f0f31e68919.slice/crio-5a134c3ad1faebb555a7d482d1cea1e8b9f7ebc7dbb5656174b37e469f6c0f01 WatchSource:0}: Error finding container 5a134c3ad1faebb555a7d482d1cea1e8b9f7ebc7dbb5656174b37e469f6c0f01: Status 404 returned error can't find the container with id 5a134c3ad1faebb555a7d482d1cea1e8b9f7ebc7dbb5656174b37e469f6c0f01
Jul 17 18:54:50.949143 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.949128    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwqs5"
Jul 17 18:54:50.949642 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:50.949623    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode418ccff_ee04_4dad_bbd2_719e05a7f03d.slice/crio-067ebe74373a4ddff6147c95b8f20641d6739cded34aac3ec8b126be599f93b2 WatchSource:0}: Error finding container 067ebe74373a4ddff6147c95b8f20641d6739cded34aac3ec8b126be599f93b2: Status 404 returned error can't find the container with id 067ebe74373a4ddff6147c95b8f20641d6739cded34aac3ec8b126be599f93b2
Jul 17 18:54:50.954163 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.954150    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2j289"
Jul 17 18:54:50.957500 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:50.957483    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ee2974_73ae_4179_b6af_4e9e62fbd957.slice/crio-7a57a5ddc4bc4b20c869009886ba0d5f5136959a33ffec4a0e8c75009666dc09 WatchSource:0}: Error finding container 7a57a5ddc4bc4b20c869009886ba0d5f5136959a33ffec4a0e8c75009666dc09: Status 404 returned error can't find the container with id 7a57a5ddc4bc4b20c869009886ba0d5f5136959a33ffec4a0e8c75009666dc09
Jul 17 18:54:50.958690 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.958631    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:54:50.961379 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:50.961360    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aed984b_c4cb_4681_81e1_42a4cb1b7f6a.slice/crio-1f2c99fe4b67d6557121bef2d59295885dbcaadaff4cba3b07a4bc97f65dc703 WatchSource:0}: Error finding container 1f2c99fe4b67d6557121bef2d59295885dbcaadaff4cba3b07a4bc97f65dc703: Status 404 returned error can't find the container with id 1f2c99fe4b67d6557121bef2d59295885dbcaadaff4cba3b07a4bc97f65dc703
Jul 17 18:54:50.964923 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.964899    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p"
Jul 17 18:54:50.966226 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:50.966206    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7767ae00_af27_49e0_97bd_c67d3b3bbf32.slice/crio-8e3dcd94ddab87d1af880328f284a5db481d09ec8998e7dbc27e4a77f6f3b042 WatchSource:0}: Error finding container 8e3dcd94ddab87d1af880328f284a5db481d09ec8998e7dbc27e4a77f6f3b042: Status 404 returned error can't find the container with id 8e3dcd94ddab87d1af880328f284a5db481d09ec8998e7dbc27e4a77f6f3b042
Jul 17 18:54:50.970546 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:50.970529    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pxqtj"
Jul 17 18:54:50.974472 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:50.974452    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6385e42_0b9c_42b3_9cca_636482e1238d.slice/crio-7294da3f59824ae01c1718c7a62ae9c722631ff8a4d86efd05ab06f1bf399fbb WatchSource:0}: Error finding container 7294da3f59824ae01c1718c7a62ae9c722631ff8a4d86efd05ab06f1bf399fbb: Status 404 returned error can't find the container with id 7294da3f59824ae01c1718c7a62ae9c722631ff8a4d86efd05ab06f1bf399fbb
Jul 17 18:54:50.981446 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:54:50.981423    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ae9ddf_d138_4b59_ab7e_8e62d8c656a8.slice/crio-b4e57980d7468c312158a481495961aa02cf4844d34c4a98463ba69fdfaa88a7 WatchSource:0}: Error finding container b4e57980d7468c312158a481495961aa02cf4844d34c4a98463ba69fdfaa88a7: Status 404 returned error can't find the container with id b4e57980d7468c312158a481495961aa02cf4844d34c4a98463ba69fdfaa88a7
Jul 17 18:54:51.041500 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.041478    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:54:51.338095 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.338032    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:51.338095 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.338083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:51.338303 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:51.338166    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:51.338303 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:51.338171    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:51.338303 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:51.338219    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs podName:dc317da8-729e-4b00-bc8e-8694b867da64 nodeName:}" failed. No retries permitted until 2026-07-17 18:54:52.338205077 +0000 UTC m=+4.078957863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs") pod "network-metrics-daemon-8xrbc" (UID: "dc317da8-729e-4b00-bc8e-8694b867da64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:51.338303 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:51.338232    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret podName:f81b37e7-4f8b-42e9-8af1-187f5d26cd27 nodeName:}" failed. No retries permitted until 2026-07-17 18:54:52.338226385 +0000 UTC m=+4.078979171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret") pod "global-pull-secret-syncer-h9wdv" (UID: "f81b37e7-4f8b-42e9-8af1-187f5d26cd27") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:51.438790 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.438768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:51.438886 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:51.438869    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:54:51.438886 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:51.438881    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:54:51.438962 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:51.438890    2558 projected.go:196] Error preparing data for projected volume kube-api-access-www2d for pod openshift-network-diagnostics/network-check-target-jn5nj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:51.438962 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:51.438932    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d podName:c429a0ee-0a90-408d-9932-8093b987145d nodeName:}" failed. No retries permitted until 2026-07-17 18:54:52.438919708 +0000 UTC m=+4.179672495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-www2d" (UniqueName: "kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d") pod "network-check-target-jn5nj" (UID: "c429a0ee-0a90-408d-9932-8093b987145d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:51.657714 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.657533    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:49:49 +0000 UTC" deadline="2028-02-08 20:54:56.286511539 +0000 UTC"
Jul 17 18:54:51.657714 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.657591    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13706h0m4.628925133s"
Jul 17 18:54:51.726418 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.725669    2558 generic.go:356] "Generic (PLEG): container finished" podID="1887ae439b2a3b9cf7ae9dd23a2eb4c4" containerID="dc265ab97c4cf3323ddc665c6237ca0420377236a4fbf3b920b87a364b662bd6" exitCode=0
Jul 17 18:54:51.726418 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.726101    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" event={"ID":"1887ae439b2a3b9cf7ae9dd23a2eb4c4","Type":"ContainerDied","Data":"dc265ab97c4cf3323ddc665c6237ca0420377236a4fbf3b920b87a364b662bd6"}
Jul 17 18:54:51.737004 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.736885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p" event={"ID":"b6385e42-0b9c-42b3-9cca-636482e1238d","Type":"ContainerStarted","Data":"7294da3f59824ae01c1718c7a62ae9c722631ff8a4d86efd05ab06f1bf399fbb"}
Jul 17 18:54:51.764498 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.764410    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4s9r8" event={"ID":"e418ccff-ee04-4dad-bbd2-719e05a7f03d","Type":"ContainerStarted","Data":"067ebe74373a4ddff6147c95b8f20641d6739cded34aac3ec8b126be599f93b2"}
Jul 17 18:54:51.770129 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.770103    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rxt25" event={"ID":"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac","Type":"ContainerStarted","Data":"7bb2ab061a7a06ef520137b758d7acf85fde7fc022038e1a7381b545dec84b4c"}
Jul 17 18:54:51.776980 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.776801    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerStarted","Data":"1a0b6aabf411d58bd538146c9c66f6b73169b3e0bbff7a5c266621a29851ef38"}
Jul 17 18:54:51.802181 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.802147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pxqtj" event={"ID":"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8","Type":"ContainerStarted","Data":"b4e57980d7468c312158a481495961aa02cf4844d34c4a98463ba69fdfaa88a7"}
Jul 17 18:54:51.804216 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.804170    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-27zjz" event={"ID":"7767ae00-af27-49e0-97bd-c67d3b3bbf32","Type":"ContainerStarted","Data":"8e3dcd94ddab87d1af880328f284a5db481d09ec8998e7dbc27e4a77f6f3b042"}
Jul 17 18:54:51.814055 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.814024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j289" event={"ID":"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a","Type":"ContainerStarted","Data":"1f2c99fe4b67d6557121bef2d59295885dbcaadaff4cba3b07a4bc97f65dc703"}
Jul 17 18:54:51.837062 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.837030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwqs5" event={"ID":"76ee2974-73ae-4179-b6af-4e9e62fbd957","Type":"ContainerStarted","Data":"7a57a5ddc4bc4b20c869009886ba0d5f5136959a33ffec4a0e8c75009666dc09"}
Jul 17 18:54:51.874123 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:51.874091    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mlhgm" event={"ID":"7a50c790-77cd-4268-b02a-9f0f31e68919","Type":"ContainerStarted","Data":"5a134c3ad1faebb555a7d482d1cea1e8b9f7ebc7dbb5656174b37e469f6c0f01"}
Jul 17 18:54:52.355998 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:52.355909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:52.355998 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:52.355988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:52.356259 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.356110    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:52.356259 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.356171    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs podName:dc317da8-729e-4b00-bc8e-8694b867da64 nodeName:}" failed. No retries permitted until 2026-07-17 18:54:54.356153674 +0000 UTC m=+6.096906466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs") pod "network-metrics-daemon-8xrbc" (UID: "dc317da8-729e-4b00-bc8e-8694b867da64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:52.356577 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.356557    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:52.356714 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.356628    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret podName:f81b37e7-4f8b-42e9-8af1-187f5d26cd27 nodeName:}" failed. No retries permitted until 2026-07-17 18:54:54.35661213 +0000 UTC m=+6.097364931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret") pod "global-pull-secret-syncer-h9wdv" (UID: "f81b37e7-4f8b-42e9-8af1-187f5d26cd27") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:52.457899 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:52.457292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:52.457899 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.457469    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:54:52.457899 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.457487    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:54:52.457899 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.457502    2558 projected.go:196] Error preparing data for projected volume kube-api-access-www2d for pod openshift-network-diagnostics/network-check-target-jn5nj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:52.457899 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.457555    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d podName:c429a0ee-0a90-408d-9932-8093b987145d nodeName:}" failed. No retries permitted until 2026-07-17 18:54:54.457537252 +0000 UTC m=+6.198290062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-www2d" (UniqueName: "kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d") pod "network-check-target-jn5nj" (UID: "c429a0ee-0a90-408d-9932-8093b987145d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:52.712350 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:52.712247    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:52.712835 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.712369    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:54:52.712835 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:52.712788    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:52.712951 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.712882    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:54:52.713010 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:52.712951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:52.713057 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:52.713030    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:54:52.895648 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:52.895356    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" event={"ID":"1887ae439b2a3b9cf7ae9dd23a2eb4c4","Type":"ContainerStarted","Data":"7effdc0bb9962f6c3ea4769c147f91f627a8655e98bcc4fc3a9d8c806ca93c2c"}
Jul 17 18:54:54.372473 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:54.371716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:54.372473 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:54.371795    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:54.372473 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.371933    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:54.372473 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.371998    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs podName:dc317da8-729e-4b00-bc8e-8694b867da64 nodeName:}" failed. No retries permitted until 2026-07-17 18:54:58.371979213 +0000 UTC m=+10.112732021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs") pod "network-metrics-daemon-8xrbc" (UID: "dc317da8-729e-4b00-bc8e-8694b867da64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:54.372473 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.372383    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:54.372473 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.372433    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret podName:f81b37e7-4f8b-42e9-8af1-187f5d26cd27 nodeName:}" failed. No retries permitted until 2026-07-17 18:54:58.372417247 +0000 UTC m=+10.113170040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret") pod "global-pull-secret-syncer-h9wdv" (UID: "f81b37e7-4f8b-42e9-8af1-187f5d26cd27") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:54.472895 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:54.472150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:54.472895 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.472388    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:54:54.472895 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.472411    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:54:54.472895 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.472424    2558 projected.go:196] Error preparing data for projected volume kube-api-access-www2d for pod openshift-network-diagnostics/network-check-target-jn5nj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:54.472895 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.472482    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d podName:c429a0ee-0a90-408d-9932-8093b987145d nodeName:}" failed. No retries permitted until 2026-07-17 18:54:58.47246414 +0000 UTC m=+10.213216952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-www2d" (UniqueName: "kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d") pod "network-check-target-jn5nj" (UID: "c429a0ee-0a90-408d-9932-8093b987145d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:54.709772 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:54.708943    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:54.709772 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.709063    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:54:54.709772 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:54.709426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:54.709772 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.709533    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:54:54.709772 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:54.709590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:54.709772 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:54.709692    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:54:56.712216 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:56.712179    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:56.712617 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:56.712313    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:54:56.712771 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:56.712755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:56.712880 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:56.712846    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:54:56.712936 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:56.712912    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:56.713013 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:56.712995    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:54:58.407570 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:58.407526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:58.408029 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:58.407626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:58.408029 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.407785    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:58.408029 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.407841    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret podName:f81b37e7-4f8b-42e9-8af1-187f5d26cd27 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:06.407827916 +0000 UTC m=+18.148580706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret") pod "global-pull-secret-syncer-h9wdv" (UID: "f81b37e7-4f8b-42e9-8af1-187f5d26cd27") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:54:58.408233 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.408216    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:58.408289 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.408267    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs podName:dc317da8-729e-4b00-bc8e-8694b867da64 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:06.408255374 +0000 UTC m=+18.149008161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs") pod "network-metrics-daemon-8xrbc" (UID: "dc317da8-729e-4b00-bc8e-8694b867da64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:54:58.508823 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:58.508784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:58.509006 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.508980    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:54:58.509006 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.508999    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:54:58.509112 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.509012    2558 projected.go:196] Error preparing data for projected volume kube-api-access-www2d for pod openshift-network-diagnostics/network-check-target-jn5nj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:58.509112 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.509069    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d podName:c429a0ee-0a90-408d-9932-8093b987145d nodeName:}" failed. No retries permitted until 2026-07-17 18:55:06.509051558 +0000 UTC m=+18.249804361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-www2d" (UniqueName: "kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d") pod "network-check-target-jn5nj" (UID: "c429a0ee-0a90-408d-9932-8093b987145d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:54:58.710464 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:58.710388    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:54:58.710615 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.710514    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:54:58.710908 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:58.710889    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:54:58.711022 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.710991    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:54:58.711142 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:54:58.711119    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:54:58.711208 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:54:58.711190    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:00.709894 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:00.709849    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:00.710284 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:00.709860    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:00.710284 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:00.710052    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:00.710284 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:00.709849    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:00.710284 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:00.710121    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:00.710284 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:00.710208    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:02.708938 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:02.708898    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:02.708938 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:02.708930    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:02.709451 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:02.709015    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:02.709451 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:02.709032    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:02.709451 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:02.709081    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:02.709451 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:02.709172    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:04.709466 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:04.709425    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:04.709924 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:04.709428    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:04.709924 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:04.709563    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:04.709924 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:04.709568    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:04.709924 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:04.709686    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:04.709924 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:04.709814    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:06.469574 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:06.469535    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:06.470152 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:06.469620    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:06.470152 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.469728    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:55:06.470152 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.469810    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret podName:f81b37e7-4f8b-42e9-8af1-187f5d26cd27 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:22.469788338 +0000 UTC m=+34.210541124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret") pod "global-pull-secret-syncer-h9wdv" (UID: "f81b37e7-4f8b-42e9-8af1-187f5d26cd27") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:55:06.470152 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.469726    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:55:06.470152 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.469892    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs podName:dc317da8-729e-4b00-bc8e-8694b867da64 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:22.469872598 +0000 UTC m=+34.210625393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs") pod "network-metrics-daemon-8xrbc" (UID: "dc317da8-729e-4b00-bc8e-8694b867da64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:55:06.570905 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:06.570841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:06.571079 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.570980    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:55:06.571079 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.571005    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:55:06.571079 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.571014    2558 projected.go:196] Error preparing data for projected volume kube-api-access-www2d for pod openshift-network-diagnostics/network-check-target-jn5nj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:55:06.571079 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.571067    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d podName:c429a0ee-0a90-408d-9932-8093b987145d nodeName:}" failed. No retries permitted until 2026-07-17 18:55:22.571053497 +0000 UTC m=+34.311806284 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-www2d" (UniqueName: "kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d") pod "network-check-target-jn5nj" (UID: "c429a0ee-0a90-408d-9932-8093b987145d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:55:06.709731 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:06.709690    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:06.709915 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:06.709708    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:06.709915 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:06.709828    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:06.709915 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.709828    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:06.710073 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.709961    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:06.710073 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:06.710048    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:08.709932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:08.709894    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:08.710333 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:08.710002    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:08.710333 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:08.710013    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:08.710333 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:08.710087    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:08.710333 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:08.710106    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:08.710333 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:08.710164    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:10.709630 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:10.709131    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:10.709630 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:10.709135    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:10.709630 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:10.709269    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:10.709630 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:10.709301    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:10.709630 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:10.709394    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:10.709630 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:10.709460    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:11.940490 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.940218    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mlhgm" event={"ID":"7a50c790-77cd-4268-b02a-9f0f31e68919","Type":"ContainerStarted","Data":"4206a1db5fee96f71a0aef96b51318b9d0416aabe0b29550eded601cdaab4c4f"}
Jul 17 18:55:11.942216 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.942074    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal" event={"ID":"b627e4843adfbd64039515f41cb64e53","Type":"ContainerStarted","Data":"b275445d5337561304379cb8ea02857ae488ce897c816741ded4ae3006fd0a2c"}
Jul 17 18:55:11.943572 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.943550    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p" event={"ID":"b6385e42-0b9c-42b3-9cca-636482e1238d","Type":"ContainerStarted","Data":"cb84822ea0fab3b307b80533f21024b0c71d6615813c01b0d62cf36486de6a71"}
Jul 17 18:55:11.945059 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.945041    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4s9r8" event={"ID":"e418ccff-ee04-4dad-bbd2-719e05a7f03d","Type":"ContainerStarted","Data":"2862efee396071b6b4d1b1d4c283173d6a7c1c2292ce5b4b3dcb8f092b060032"}
Jul 17 18:55:11.946502 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.946479    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rxt25" event={"ID":"0afd6108-c5dc-4376-ad7c-a8ed05fb69ac","Type":"ContainerStarted","Data":"aabc8cab6693e5391f5ec1637af16662114a918685ff4b8a872a2d2d2e50f777"}
Jul 17 18:55:11.949403 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.949386    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 18:55:11.949715 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.949697    2558 generic.go:356] "Generic (PLEG): container finished" podID="1d18f624-cf3c-4582-8e2a-f865c68b0168" containerID="145495f95644747c535e11bfac0f498261574098296e19632666bc18a9994c99" exitCode=1
Jul 17 18:55:11.949777 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.949758    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerStarted","Data":"b18f9f9c55b4801dfb094ce2fb64cbb109f321b237f498178ab305e0ffba411c"}
Jul 17 18:55:11.949823 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.949803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerDied","Data":"145495f95644747c535e11bfac0f498261574098296e19632666bc18a9994c99"}
Jul 17 18:55:11.949863 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.949834    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerStarted","Data":"5bdddda62b94786cadc8942cf41504b15e64d6d7d8c439379894e01fe5ad312e"}
Jul 17 18:55:11.951169 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.951143    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pxqtj" event={"ID":"c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8","Type":"ContainerStarted","Data":"8cfc051173751a07ac329258bc7d7bc5ff5c50464e3182d868cb805c56f20867"}
Jul 17 18:55:11.952734 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.952714    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-27zjz" event={"ID":"7767ae00-af27-49e0-97bd-c67d3b3bbf32","Type":"ContainerStarted","Data":"1ca75dd1d6397aca8a4fb7e54ef5632b6feb7889b8d6db3db72e2ade96f6cf54"}
Jul 17 18:55:11.954098 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.954072    2558 generic.go:356] "Generic (PLEG): container finished" podID="4aed984b-c4cb-4681-81e1-42a4cb1b7f6a" containerID="04d21bd41e214bffac08a2d81d17ceeb6dd53aa3f0b0ed16f4635be6619e9cb0" exitCode=0
Jul 17 18:55:11.954181 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.954106    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j289" event={"ID":"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a","Type":"ContainerDied","Data":"04d21bd41e214bffac08a2d81d17ceeb6dd53aa3f0b0ed16f4635be6619e9cb0"}
Jul 17 18:55:11.958030 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.957993    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mlhgm" podStartSLOduration=3.62067636 podStartE2EDuration="23.957947797s" totalImagesPullingTime="20.337271437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:11.957811823 +0000 UTC m=+23.698564633" watchObservedRunningTime="2026-07-17 18:55:11.957947797 +0000 UTC m=+23.698700606"
Jul 17 18:55:11.958178 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.958157    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" podStartSLOduration=22.958150306 podStartE2EDuration="22.958150306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:52.916289746 +0000 UTC m=+4.657042555" watchObservedRunningTime="2026-07-17 18:55:11.958150306 +0000 UTC m=+23.698903116"
Jul 17 18:55:11.973188 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:11.973151    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal" podStartSLOduration=22.973141388 podStartE2EDuration="22.973141388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:11.972730274 +0000 UTC m=+23.713483082" watchObservedRunningTime="2026-07-17 18:55:11.973141388 +0000 UTC m=+23.713894196"
Jul 17 18:55:12.011979 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.011949    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-27zjz" podStartSLOduration=2.698072989 podStartE2EDuration="23.011939302s" totalImagesPullingTime="20.313866313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:12.011888181 +0000 UTC m=+23.752640991" watchObservedRunningTime="2026-07-17 18:55:12.011939302 +0000 UTC m=+23.752692111"
Jul 17 18:55:12.012060 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.012048    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4s9r8" podStartSLOduration=3.703670149 podStartE2EDuration="24.012044369s" totalImagesPullingTime="20.30837422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:11.993655649 +0000 UTC m=+23.734408457" watchObservedRunningTime="2026-07-17 18:55:12.012044369 +0000 UTC m=+23.752797178"
Jul 17 18:55:12.028374 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.028342    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pxqtj" podStartSLOduration=2.717520332 podStartE2EDuration="23.028330374s" totalImagesPullingTime="20.310810042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:12.028003223 +0000 UTC m=+23.768756032" watchObservedRunningTime="2026-07-17 18:55:12.028330374 +0000 UTC m=+23.769083205"
Jul 17 18:55:12.065644 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.065584    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rxt25" podStartSLOduration=3.721530165 podStartE2EDuration="24.065574357s" totalImagesPullingTime="20.344044192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:12.043508428 +0000 UTC m=+23.784261238" watchObservedRunningTime="2026-07-17 18:55:12.065574357 +0000 UTC m=+23.806327166"
Jul 17 18:55:12.708995 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.708935    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:12.709162 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.708935    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:12.709162 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:12.709038    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:12.709162 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.709048    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:12.709325 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:12.709162    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:12.709325 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:12.709272    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:12.903440 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.903411    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:55:12.904103 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.904087    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:55:12.956972 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.956946    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwqs5" event={"ID":"76ee2974-73ae-4179-b6af-4e9e62fbd957","Type":"ContainerStarted","Data":"81a5cd79452594823fc7313ea042c3b8055b6b8d249ee7ee64edf9388c8c8053"}
Jul 17 18:55:12.959317 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.959272    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 18:55:12.959664 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.959639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerStarted","Data":"f9587a4363f33ce94dc21ced877b40ea39ac7e86d4f09987016e707519231e9e"}
Jul 17 18:55:12.959749 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.959689    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerStarted","Data":"c853521153a2cad3496c21c89bdb74888ba0e4f64fabbc780be669d3ccadd9ec"}
Jul 17 18:55:12.959749 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.959717    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerStarted","Data":"9d0cbf973654ce6316cc990b248cf154ef99b30772f01e4d206ef699c5274d0a"}
Jul 17 18:55:12.972960 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:12.972921    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hwqs5" podStartSLOduration=4.671187801 podStartE2EDuration="24.972909163s" totalImagesPullingTime="20.301721362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:12.972692818 +0000 UTC m=+24.713445626" watchObservedRunningTime="2026-07-17 18:55:12.972909163 +0000 UTC m=+24.713661971"
Jul 17 18:55:13.274466 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:13.274444    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 18:55:13.682038 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:13.681855    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T18:55:13.274459748Z","UUID":"7d3007c3-af1f-4a50-8593-cfa8567f0a45","Handler":null,"Name":"","Endpoint":""}
Jul 17 18:55:13.683503 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:13.683479    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 18:55:13.683628 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:13.683527    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 18:55:13.963706 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:13.963631    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p" event={"ID":"b6385e42-0b9c-42b3-9cca-636482e1238d","Type":"ContainerStarted","Data":"3e8a2797e0e9cb59b6582b9a17b27cee2a6f56853bd835463fcb77aa03a5b0dd"}
Jul 17 18:55:13.963706 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:13.963674    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 18:55:14.369566 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:14.369426    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:55:14.370049 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:14.370033    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-27zjz"
Jul 17 18:55:14.709395 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:14.709321    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:14.709528 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:14.709452    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:14.709838 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:14.709821    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:14.709934 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:14.709917    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:14.710083 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:14.710061    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:14.710171 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:14.710154    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:14.969779 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:14.969722    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 18:55:14.970251 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:14.970202    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerStarted","Data":"e71d2e163a3d6f9a9fbf69ca1ffc4675bc43d8af1e9d8ae11a1b913e3ec31aa7"}
Jul 17 18:55:15.974898 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:15.974859    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p" event={"ID":"b6385e42-0b9c-42b3-9cca-636482e1238d","Type":"ContainerStarted","Data":"4e6920c4e6a254886930e330cb23d8df17735a2aae1d634a17f406811832496d"}
Jul 17 18:55:16.709888 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:16.709812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:16.710043 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:16.709812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:16.710043 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:16.709939    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:16.710163 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:16.710052    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:16.710163 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:16.710095    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:16.710243 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:16.710212    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:17.982538 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:17.982377    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 18:55:17.982910 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:17.982894    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerStarted","Data":"40c63005d68ac9de8aced74a290c8a10988eec9033f8240ceaa5213220944178"}
Jul 17 18:55:17.983200 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:17.983183    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:55:17.983353 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:17.983339    2558 scope.go:117] "RemoveContainer" containerID="145495f95644747c535e11bfac0f498261574098296e19632666bc18a9994c99"
Jul 17 18:55:17.998933 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:17.998912    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:55:18.013013 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.012975    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdg9p" podStartSLOduration=5.05472921 podStartE2EDuration="29.012961195s" totalImagesPullingTime="23.958231985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:15.994907235 +0000 UTC m=+27.735660044" watchObservedRunningTime="2026-07-17 18:55:18.012961195 +0000 UTC m=+29.753714004"
Jul 17 18:55:18.709852 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.709831    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:18.709964 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:18.709912    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:18.710016 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.710005    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:18.710124 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.710110    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:18.710178 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:18.710125    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:18.710221 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:18.710181    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:18.987197 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.987123    2558 generic.go:356] "Generic (PLEG): container finished" podID="4aed984b-c4cb-4681-81e1-42a4cb1b7f6a" containerID="a7a1de267f244684149587422612a6efc680830317b01144f7b2d7947515475e" exitCode=0
Jul 17 18:55:18.987657 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.987214    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j289" event={"ID":"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a","Type":"ContainerDied","Data":"a7a1de267f244684149587422612a6efc680830317b01144f7b2d7947515475e"}
Jul 17 18:55:18.991213 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.991193    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 18:55:18.991564 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.991543    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" event={"ID":"1d18f624-cf3c-4582-8e2a-f865c68b0168","Type":"ContainerStarted","Data":"56563ef3e49ee509ab994b0aaa51e8494e72cc05b0596c7bdf431695598c1d59"}
Jul 17 18:55:18.991936 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.991919    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:55:18.992042 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:18.992003    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:55:19.007172 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:19.007155    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:55:19.050050 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:19.050009    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz" podStartSLOduration=10.4087178 podStartE2EDuration="31.049997936s" totalImagesPullingTime="20.641280136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:19.049940684 +0000 UTC m=+30.790693492" watchObservedRunningTime="2026-07-17 18:55:19.049997936 +0000 UTC m=+30.790750744"
Jul 17 18:55:19.741696 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:19.741666    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jn5nj"]
Jul 17 18:55:19.741874 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:19.741821    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:19.741936 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:19.741913    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:19.742302 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:19.742281    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8xrbc"]
Jul 17 18:55:19.742411 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:19.742396    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:19.742531 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:19.742503    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:19.750414 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:19.750393    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h9wdv"]
Jul 17 18:55:19.750517 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:19.750469    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:19.750560 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:19.750534    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:20.998354 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:20.998229    2558 generic.go:356] "Generic (PLEG): container finished" podID="4aed984b-c4cb-4681-81e1-42a4cb1b7f6a" containerID="5722c05038a80bdfc8ff663832c42ff98c72095a768feb69ef048cb460c47372" exitCode=0
Jul 17 18:55:20.998774 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:20.998292    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j289" event={"ID":"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a","Type":"ContainerDied","Data":"5722c05038a80bdfc8ff663832c42ff98c72095a768feb69ef048cb460c47372"}
Jul 17 18:55:21.709725 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:21.709694    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:21.709906 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:21.709803    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:21.709906 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:21.709812    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:21.709906 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:21.709833    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:21.710021 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:21.709912    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:21.710021 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:21.709982    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:22.492950 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:22.492926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:22.493274 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:22.492982    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:22.493274 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:22.493056    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:55:22.493274 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:22.493060    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:55:22.493274 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:22.493116    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs podName:dc317da8-729e-4b00-bc8e-8694b867da64 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:54.493101791 +0000 UTC m=+66.233854577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs") pod "network-metrics-daemon-8xrbc" (UID: "dc317da8-729e-4b00-bc8e-8694b867da64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:55:22.493274 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:22.493130    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret podName:f81b37e7-4f8b-42e9-8af1-187f5d26cd27 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:54.493123442 +0000 UTC m=+66.233876229 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret") pod "global-pull-secret-syncer-h9wdv" (UID: "f81b37e7-4f8b-42e9-8af1-187f5d26cd27") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:55:22.593466 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:22.593443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:22.593578 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:22.593567    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:55:22.593647 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:22.593584    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:55:22.593647 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:22.593593    2558 projected.go:196] Error preparing data for projected volume kube-api-access-www2d for pod openshift-network-diagnostics/network-check-target-jn5nj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:55:22.593731 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:22.593651    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d podName:c429a0ee-0a90-408d-9932-8093b987145d nodeName:}" failed. No retries permitted until 2026-07-17 18:55:54.593639969 +0000 UTC m=+66.334392758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-www2d" (UniqueName: "kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d") pod "network-check-target-jn5nj" (UID: "c429a0ee-0a90-408d-9932-8093b987145d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:55:23.004342 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:23.004309    2558 generic.go:356] "Generic (PLEG): container finished" podID="4aed984b-c4cb-4681-81e1-42a4cb1b7f6a" containerID="5ae5e6f2bf0e8e23ec699f991be6065bf0239be20dd867e3bd6c332bca1cb237" exitCode=0
Jul 17 18:55:23.004465 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:23.004358    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j289" event={"ID":"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a","Type":"ContainerDied","Data":"5ae5e6f2bf0e8e23ec699f991be6065bf0239be20dd867e3bd6c332bca1cb237"}
Jul 17 18:55:23.709058 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:23.709027    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:23.709058 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:23.709045    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:23.709534 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:23.709136    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:23.709534 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:23.709149    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xrbc" podUID="dc317da8-729e-4b00-bc8e-8694b867da64"
Jul 17 18:55:23.709534 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:23.709245    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn5nj" podUID="c429a0ee-0a90-408d-9932-8093b987145d"
Jul 17 18:55:23.709534 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:23.709291    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9wdv" podUID="f81b37e7-4f8b-42e9-8af1-187f5d26cd27"
Jul 17 18:55:25.077588 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.076732    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeReady"
Jul 17 18:55:25.077588 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.076872    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 18:55:25.127171 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.127090    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8bfbf8569-26gc9"]
Jul 17 18:55:25.128887 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.128868    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.136866 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.136845    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 18:55:25.136964 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.136871    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zbkpp\""
Jul 17 18:55:25.137080 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.137067    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 18:55:25.137702 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.137686    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 18:55:25.143533 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.143512    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 18:55:25.151805 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.151787    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5bl2v"]
Jul 17 18:55:25.154212 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.153867    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.154836 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.154761    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8bfbf8569-26gc9"]
Jul 17 18:55:25.155582 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.155429    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dtwgf"]
Jul 17 18:55:25.157074 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.157056    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dtwgf"
Jul 17 18:55:25.158331 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.158316    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 18:55:25.158546 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.158528    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfsnb\""
Jul 17 18:55:25.158655 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.158596    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 18:55:25.159569 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.159550    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 18:55:25.160121 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.160104    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lp744\""
Jul 17 18:55:25.160121 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.160119    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 18:55:25.160280 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.160264    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 18:55:25.176865 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.176842    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bl2v"]
Jul 17 18:55:25.177360 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.177344    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dtwgf"]
Jul 17 18:55:25.313327 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313294    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfn4k\" (UniqueName: \"kubernetes.io/projected/efa9c633-2f06-4ea2-8fa3-3b4b02b9809b-kube-api-access-vfn4k\") pod \"ingress-canary-dtwgf\" (UID: \"efa9c633-2f06-4ea2-8fa3-3b4b02b9809b\") " pod="openshift-ingress-canary/ingress-canary-dtwgf"
Jul 17 18:55:25.313499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-trusted-ca\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.313499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efa9c633-2f06-4ea2-8fa3-3b4b02b9809b-cert\") pod \"ingress-canary-dtwgf\" (UID: \"efa9c633-2f06-4ea2-8fa3-3b4b02b9809b\") " pod="openshift-ingress-canary/ingress-canary-dtwgf"
Jul 17 18:55:25.313499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-config-volume\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.313499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313431    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b248cdbd-a918-4462-a36b-8b7bdd138db1-ca-trust-extracted\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.313499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-certificates\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.313499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-installation-pull-secrets\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.313499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-bound-sa-token\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.313927 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72fk4\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-kube-api-access-72fk4\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.313927 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313620    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.313927 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwgn2\" (UniqueName: \"kubernetes.io/projected/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-kube-api-access-gwgn2\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.313927 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313692    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-image-registry-private-configuration\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.313927 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-tmp-dir\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.313927 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.313753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.336008 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.335973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:25.415029 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.414947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-trusted-ca\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415029 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.414978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efa9c633-2f06-4ea2-8fa3-3b4b02b9809b-cert\") pod \"ingress-canary-dtwgf\" (UID: \"efa9c633-2f06-4ea2-8fa3-3b4b02b9809b\") " pod="openshift-ingress-canary/ingress-canary-dtwgf"
Jul 17 18:55:25.415029 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.414997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-config-volume\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.415029 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415018    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b248cdbd-a918-4462-a36b-8b7bdd138db1-ca-trust-extracted\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415337 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-certificates\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415337 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-installation-pull-secrets\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415337 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-bound-sa-token\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415337 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72fk4\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-kube-api-access-72fk4\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415337 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415327    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.415568 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwgn2\" (UniqueName: \"kubernetes.io/projected/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-kube-api-access-gwgn2\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.415568 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-image-registry-private-configuration\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415568 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-tmp-dir\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.415568 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415438    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415568 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b248cdbd-a918-4462-a36b-8b7bdd138db1-ca-trust-extracted\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415568 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415479    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfn4k\" (UniqueName: \"kubernetes.io/projected/efa9c633-2f06-4ea2-8fa3-3b4b02b9809b-kube-api-access-vfn4k\") pod \"ingress-canary-dtwgf\" (UID: \"efa9c633-2f06-4ea2-8fa3-3b4b02b9809b\") " pod="openshift-ingress-canary/ingress-canary-dtwgf"
Jul 17 18:55:25.415892 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415711    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-config-volume\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.415892 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.415826    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-certificates\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.415892 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.415874    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:55:25.416039 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.415930    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls podName:e9ff6ec0-3a7e-4e0e-969c-a2619d47509a nodeName:}" failed. No retries permitted until 2026-07-17 18:55:25.915912516 +0000 UTC m=+37.656665307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls") pod "dns-default-5bl2v" (UID: "e9ff6ec0-3a7e-4e0e-969c-a2619d47509a") : secret "dns-default-metrics-tls" not found
Jul 17 18:55:25.416102 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.416058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-trusted-ca\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.416102 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.416063    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-tmp-dir\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.416102 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.416080    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:55:25.416102 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.416094    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bfbf8569-26gc9: secret "image-registry-tls" not found
Jul 17 18:55:25.416285 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.416172    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls podName:b248cdbd-a918-4462-a36b-8b7bdd138db1 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:25.916142528 +0000 UTC m=+37.656895315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls") pod "image-registry-8bfbf8569-26gc9" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1") : secret "image-registry-tls" not found
Jul 17 18:55:25.419930 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.419905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-installation-pull-secrets\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.419930 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.419920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-image-registry-private-configuration\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.420095 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.419912    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efa9c633-2f06-4ea2-8fa3-3b4b02b9809b-cert\") pod \"ingress-canary-dtwgf\" (UID: \"efa9c633-2f06-4ea2-8fa3-3b4b02b9809b\") " pod="openshift-ingress-canary/ingress-canary-dtwgf"
Jul 17 18:55:25.423981 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.423958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-bound-sa-token\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.425127 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.424701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72fk4\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-kube-api-access-72fk4\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.425127 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.425053    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfn4k\" (UniqueName: \"kubernetes.io/projected/efa9c633-2f06-4ea2-8fa3-3b4b02b9809b-kube-api-access-vfn4k\") pod \"ingress-canary-dtwgf\" (UID: \"efa9c633-2f06-4ea2-8fa3-3b4b02b9809b\") " pod="openshift-ingress-canary/ingress-canary-dtwgf"
Jul 17 18:55:25.425127 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.425071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwgn2\" (UniqueName: \"kubernetes.io/projected/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-kube-api-access-gwgn2\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.435080 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.435054    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:25.470113 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.470093    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dtwgf"
Jul 17 18:55:25.546622 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.543050    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:25.624866 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.624832    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dtwgf"]
Jul 17 18:55:25.631263 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:25.631227    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa9c633_2f06_4ea2_8fa3_3b4b02b9809b.slice/crio-24794cdd976912f469733094e7f4725789d339d8b4d4dbdb5d62fbd3bada77ae WatchSource:0}: Error finding container 24794cdd976912f469733094e7f4725789d339d8b4d4dbdb5d62fbd3bada77ae: Status 404 returned error can't find the container with id 24794cdd976912f469733094e7f4725789d339d8b4d4dbdb5d62fbd3bada77ae
Jul 17 18:55:25.709418 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.709322    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:25.709418 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.709343    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:25.709418 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.709368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:25.712296 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.712278    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 18:55:25.712410 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.712339    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 18:55:25.712410 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.712379    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 18:55:25.712538 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.712445    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n57jp\""
Jul 17 18:55:25.712538 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.712476    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bqhtg\""
Jul 17 18:55:25.712656 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.712597    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 18:55:25.921021 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.920985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:25.921200 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:25.921030    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:25.921200 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.921111    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:55:25.921200 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.921122    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bfbf8569-26gc9: secret "image-registry-tls" not found
Jul 17 18:55:25.921200 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.921158    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:55:25.921200 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.921180    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls podName:b248cdbd-a918-4462-a36b-8b7bdd138db1 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:26.921165886 +0000 UTC m=+38.661918673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls") pod "image-registry-8bfbf8569-26gc9" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1") : secret "image-registry-tls" not found
Jul 17 18:55:25.921441 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:25.921231    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls podName:e9ff6ec0-3a7e-4e0e-969c-a2619d47509a nodeName:}" failed. No retries permitted until 2026-07-17 18:55:26.921213124 +0000 UTC m=+38.661965911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls") pod "dns-default-5bl2v" (UID: "e9ff6ec0-3a7e-4e0e-969c-a2619d47509a") : secret "dns-default-metrics-tls" not found
Jul 17 18:55:26.014151 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:26.014076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dtwgf" event={"ID":"efa9c633-2f06-4ea2-8fa3-3b4b02b9809b","Type":"ContainerStarted","Data":"24794cdd976912f469733094e7f4725789d339d8b4d4dbdb5d62fbd3bada77ae"}
Jul 17 18:55:26.507249 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:26.507215    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:26.565814 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:26.565753    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:26.929685 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:26.929647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:26.929866 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:26.929725    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:26.929921 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:26.929883    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:55:26.929921 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:26.929898    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bfbf8569-26gc9: secret "image-registry-tls" not found
Jul 17 18:55:26.930009 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:26.929960    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls podName:b248cdbd-a918-4462-a36b-8b7bdd138db1 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:28.929940592 +0000 UTC m=+40.670693405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls") pod "image-registry-8bfbf8569-26gc9" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1") : secret "image-registry-tls" not found
Jul 17 18:55:26.930540 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:26.930351    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:55:26.930540 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:26.930394    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls podName:e9ff6ec0-3a7e-4e0e-969c-a2619d47509a nodeName:}" failed. No retries permitted until 2026-07-17 18:55:28.93038425 +0000 UTC m=+40.671137037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls") pod "dns-default-5bl2v" (UID: "e9ff6ec0-3a7e-4e0e-969c-a2619d47509a") : secret "dns-default-metrics-tls" not found
Jul 17 18:55:27.315267 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:27.315179    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:27.369688 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:27.369650    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:28.695564 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:28.695528    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:28.940696 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:28.940657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:28.940872 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:28.940802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:28.940872 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:28.940838    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:55:28.940872 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:28.940862    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bfbf8569-26gc9: secret "image-registry-tls" not found
Jul 17 18:55:28.940997 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:28.940934    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:55:28.940997 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:28.940945    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls podName:b248cdbd-a918-4462-a36b-8b7bdd138db1 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:32.940923797 +0000 UTC m=+44.681676598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls") pod "image-registry-8bfbf8569-26gc9" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1") : secret "image-registry-tls" not found
Jul 17 18:55:28.940997 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:28.940989    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls podName:e9ff6ec0-3a7e-4e0e-969c-a2619d47509a nodeName:}" failed. No retries permitted until 2026-07-17 18:55:32.940973095 +0000 UTC m=+44.681725894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls") pod "dns-default-5bl2v" (UID: "e9ff6ec0-3a7e-4e0e-969c-a2619d47509a") : secret "dns-default-metrics-tls" not found
Jul 17 18:55:30.027582 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:30.027548    2558 generic.go:356] "Generic (PLEG): container finished" podID="4aed984b-c4cb-4681-81e1-42a4cb1b7f6a" containerID="3cd534328dea578d21cecc5b106934c10a617373fc3c0bf3d600817d474d8c58" exitCode=0
Jul 17 18:55:30.027995 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:30.027628    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j289" event={"ID":"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a","Type":"ContainerDied","Data":"3cd534328dea578d21cecc5b106934c10a617373fc3c0bf3d600817d474d8c58"}
Jul 17 18:55:30.029548 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:30.029529    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dtwgf" event={"ID":"efa9c633-2f06-4ea2-8fa3-3b4b02b9809b","Type":"ContainerStarted","Data":"17beebebd56eed5550dccd20e7aa133faa22cf88e15646b5c7219d72da7789e6"}
Jul 17 18:55:30.081253 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:30.081210    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dtwgf" podStartSLOduration=1.345076143 podStartE2EDuration="5.081195925s" totalImagesPullingTime="3.736119782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:30.079981889 +0000 UTC m=+41.820734721" watchObservedRunningTime="2026-07-17 18:55:30.081195925 +0000 UTC m=+41.821948712"
Jul 17 18:55:31.034874 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:31.034842    2558 generic.go:356] "Generic (PLEG): container finished" podID="4aed984b-c4cb-4681-81e1-42a4cb1b7f6a" containerID="e7d37a256c785786df15164c41cfdd2179597e8322e48cf272fa406fdcc06039" exitCode=0
Jul 17 18:55:31.035244 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:31.034921    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j289" event={"ID":"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a","Type":"ContainerDied","Data":"e7d37a256c785786df15164c41cfdd2179597e8322e48cf272fa406fdcc06039"}
Jul 17 18:55:32.040216 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.040184    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j289" event={"ID":"4aed984b-c4cb-4681-81e1-42a4cb1b7f6a","Type":"ContainerStarted","Data":"f98a432e5cf4487063a0a0f91bb5cf63cbd443d48f1e77a1e038711d8ed0a6e0"}
Jul 17 18:55:32.071115 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.071074    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2j289" podStartSLOduration=7.589538961 podStartE2EDuration="43.071059508s" totalImagesPullingTime="35.481520547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:32.069395534 +0000 UTC m=+43.810148342" watchObservedRunningTime="2026-07-17 18:55:32.071059508 +0000 UTC m=+43.811812316"
Jul 17 18:55:32.202257 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.202224    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:32.274341 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.274315    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:32.329522 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.329499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:32.786238 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.786164    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf"]
Jul 17 18:55:32.804797 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.804762    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx"]
Jul 17 18:55:32.804952 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.804869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf"
Jul 17 18:55:32.808359 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.808157    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6fmq7\""
Jul 17 18:55:32.816636 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.816613    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-pk4cb"]
Jul 17 18:55:32.816746 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.816727    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx"
Jul 17 18:55:32.819143 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.819123    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:55:32.819233 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.819124    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7tthm\""
Jul 17 18:55:32.819363 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.819348    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 17 18:55:32.826988 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.826968    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf"]
Jul 17 18:55:32.827115 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.826998    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75d9b569c6-grjnm"]
Jul 17 18:55:32.827115 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.827106    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.829465 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.829441    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-c6m4t\""
Jul 17 18:55:32.829883 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.829866    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 18:55:32.830166 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.830151    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 17 18:55:32.830251 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.830168    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 17 18:55:32.830251 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.830193    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 18:55:32.835888 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.835871    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 17 18:55:32.848990 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.848974    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx"]
Jul 17 18:55:32.849054 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.849005    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-pk4cb"]
Jul 17 18:55:32.849054 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.849025    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75d9b569c6-grjnm"]
Jul 17 18:55:32.849161 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.849076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.851323 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.851308    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 18:55:32.851639 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.851624    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 18:55:32.852144 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.852130    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-44gpj\""
Jul 17 18:55:32.852227 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.852174    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 18:55:32.852401 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.852385    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 18:55:32.852458 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.852410    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 18:55:32.852458 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.852424    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 18:55:32.866752 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.866734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.866831 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.866773    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-stats-auth\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.866831 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.866791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5528a224-30ce-44ce-8f02-d15b9eadc6f0-service-ca-bundle\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.866831 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.866808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5528a224-30ce-44ce-8f02-d15b9eadc6f0-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.866932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.866845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wktv\" (UniqueName: \"kubernetes.io/projected/ae0bb0ce-9178-4b58-9732-37e2b8795825-kube-api-access-5wktv\") pod \"volume-data-source-validator-78cf4c6f6-h7sgx\" (UID: \"ae0bb0ce-9178-4b58-9732-37e2b8795825\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx"
Jul 17 18:55:32.866932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.866895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgf8v\" (UniqueName: \"kubernetes.io/projected/d08e0539-ce5f-4636-93ed-6fd344b871cc-kube-api-access-fgf8v\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.866932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.866922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpmc2\" (UniqueName: \"kubernetes.io/projected/5528a224-30ce-44ce-8f02-d15b9eadc6f0-kube-api-access-xpmc2\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.867014 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.866936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5528a224-30ce-44ce-8f02-d15b9eadc6f0-serving-cert\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.867014 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.866976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-default-certificate\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.867077 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.867020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.867077 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.867061    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5528a224-30ce-44ce-8f02-d15b9eadc6f0-tmp\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.867135 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.867093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj8tp\" (UniqueName: \"kubernetes.io/projected/047a4f78-4729-4a68-95a8-cfe61cec503f-kube-api-access-fj8tp\") pod \"network-check-source-7bc5b6bf85-76rxf\" (UID: \"047a4f78-4729-4a68-95a8-cfe61cec503f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf"
Jul 17 18:55:32.867135 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.867110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5528a224-30ce-44ce-8f02-d15b9eadc6f0-snapshots\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.918364 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.918346    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-26vr8"]
Jul 17 18:55:32.939020 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.938997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:32.940360 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.940332    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"]
Jul 17 18:55:32.941204 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.941188    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 17 18:55:32.942379 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.942358    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 17 18:55:32.942857 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.942839    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:55:32.942952 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.942856    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 17 18:55:32.942952 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.942904    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8bfmw\""
Jul 17 18:55:32.948668 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.948648    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 17 18:55:32.963365 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.963341    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"]
Jul 17 18:55:32.963902 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.963885    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:32.966793 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.966774    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 17 18:55:32.966874 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.966811    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 17 18:55:32.967013 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.966996    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:55:32.967093 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967045    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 17 18:55:32.967379 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-trusted-ca\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:32.967424 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967383    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vjqsn\""
Jul 17 18:55:32.967424 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.967509 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:32.967509 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-stats-auth\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.967509 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967492    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5528a224-30ce-44ce-8f02-d15b9eadc6f0-service-ca-bundle\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.967670 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:32.967514    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:55:32.967670 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:32.967515    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 18:55:32.967670 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5528a224-30ce-44ce-8f02-d15b9eadc6f0-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.967670 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:32.967578    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls podName:e9ff6ec0-3a7e-4e0e-969c-a2619d47509a nodeName:}" failed. No retries permitted until 2026-07-17 18:55:40.967559918 +0000 UTC m=+52.708312705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls") pod "dns-default-5bl2v" (UID: "e9ff6ec0-3a7e-4e0e-969c-a2619d47509a") : secret "dns-default-metrics-tls" not found
Jul 17 18:55:32.967670 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:32.967642    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:33.467623106 +0000 UTC m=+45.208375897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : secret "router-metrics-certs-default" not found
Jul 17 18:55:32.967932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wktv\" (UniqueName: \"kubernetes.io/projected/ae0bb0ce-9178-4b58-9732-37e2b8795825-kube-api-access-5wktv\") pod \"volume-data-source-validator-78cf4c6f6-h7sgx\" (UID: \"ae0bb0ce-9178-4b58-9732-37e2b8795825\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx"
Jul 17 18:55:32.967932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967730    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgf8v\" (UniqueName: \"kubernetes.io/projected/d08e0539-ce5f-4636-93ed-6fd344b871cc-kube-api-access-fgf8v\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.967932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpmc2\" (UniqueName: \"kubernetes.io/projected/5528a224-30ce-44ce-8f02-d15b9eadc6f0-kube-api-access-xpmc2\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.967932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967788    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-config\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:32.967932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5528a224-30ce-44ce-8f02-d15b9eadc6f0-serving-cert\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.967932 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.967845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-default-certificate\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.968209 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:32.968209 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968157    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5528a224-30ce-44ce-8f02-d15b9eadc6f0-service-ca-bundle\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.968209 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhfzl\" (UniqueName: \"kubernetes.io/projected/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-kube-api-access-mhfzl\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:32.968337 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968219    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.968337 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5528a224-30ce-44ce-8f02-d15b9eadc6f0-tmp\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.968337 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj8tp\" (UniqueName: \"kubernetes.io/projected/047a4f78-4729-4a68-95a8-cfe61cec503f-kube-api-access-fj8tp\") pod \"network-check-source-7bc5b6bf85-76rxf\" (UID: \"047a4f78-4729-4a68-95a8-cfe61cec503f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf"
Jul 17 18:55:32.968337 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5528a224-30ce-44ce-8f02-d15b9eadc6f0-snapshots\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.968485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-serving-cert\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:32.968485 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5528a224-30ce-44ce-8f02-d15b9eadc6f0-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.968485 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:32.968463    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:33.468444353 +0000 UTC m=+45.209197157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : configmap references non-existent config key: service-ca.crt
Jul 17 18:55:32.968624 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:32.968532    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:55:32.968624 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:32.968544    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bfbf8569-26gc9: secret "image-registry-tls" not found
Jul 17 18:55:32.968713 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:32.968629    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls podName:b248cdbd-a918-4462-a36b-8b7bdd138db1 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:40.968592619 +0000 UTC m=+52.709345408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls") pod "image-registry-8bfbf8569-26gc9" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1") : secret "image-registry-tls" not found
Jul 17 18:55:32.968713 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.968645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5528a224-30ce-44ce-8f02-d15b9eadc6f0-tmp\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.969088 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.969066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5528a224-30ce-44ce-8f02-d15b9eadc6f0-snapshots\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.971630 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.971507    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5528a224-30ce-44ce-8f02-d15b9eadc6f0-serving-cert\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.971754 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.971726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-stats-auth\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.971810 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.971737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-default-certificate\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.989305 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.989277    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgf8v\" (UniqueName: \"kubernetes.io/projected/d08e0539-ce5f-4636-93ed-6fd344b871cc-kube-api-access-fgf8v\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:32.989540 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.989521    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj8tp\" (UniqueName: \"kubernetes.io/projected/047a4f78-4729-4a68-95a8-cfe61cec503f-kube-api-access-fj8tp\") pod \"network-check-source-7bc5b6bf85-76rxf\" (UID: \"047a4f78-4729-4a68-95a8-cfe61cec503f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf"
Jul 17 18:55:32.989903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.989885    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpmc2\" (UniqueName: \"kubernetes.io/projected/5528a224-30ce-44ce-8f02-d15b9eadc6f0-kube-api-access-xpmc2\") pod \"insights-operator-555d9d7885-pk4cb\" (UID: \"5528a224-30ce-44ce-8f02-d15b9eadc6f0\") " pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:32.990388 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.990370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wktv\" (UniqueName: \"kubernetes.io/projected/ae0bb0ce-9178-4b58-9732-37e2b8795825-kube-api-access-5wktv\") pod \"volume-data-source-validator-78cf4c6f6-h7sgx\" (UID: \"ae0bb0ce-9178-4b58-9732-37e2b8795825\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx"
Jul 17 18:55:32.997342 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.997325    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"]
Jul 17 18:55:32.997446 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.997432    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:32.999755 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.999740    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 18:55:32.999908 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:32.999778    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 17 18:55:33.000092 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.000063    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 18:55:33.001121 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.001104    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pswlx\""
Jul 17 18:55:33.001287 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.001271    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 17 18:55:33.015459 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.015438    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-26vr8"]
Jul 17 18:55:33.015527 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.015468    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"]
Jul 17 18:55:33.015569 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.015558    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:33.017919 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.017901    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s98zd\""
Jul 17 18:55:33.017919 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.017917    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 17 18:55:33.018738 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.018725    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 17 18:55:33.035773 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.035754    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"]
Jul 17 18:55:33.035839 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.035781    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"]
Jul 17 18:55:33.035839 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.035792    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"]
Jul 17 18:55:33.035839 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.035804    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"]
Jul 17 18:55:33.035839 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.035827    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"]
Jul 17 18:55:33.035972 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.035852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.038056 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.037986    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 17 18:55:33.038193 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.038179    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l4hcg\""
Jul 17 18:55:33.038193 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.038187    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:55:33.038302 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.038245    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 17 18:55:33.038514 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.038499    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 17 18:55:33.041805 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.041764    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:33.049803 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.049781    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"]
Jul 17 18:55:33.049878 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.049862    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:33.052202 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.052165    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 17 18:55:33.052317 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.052208    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 17 18:55:33.052317 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.052436    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:55:33.052317 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.052500    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lvb59\""
Jul 17 18:55:33.068740 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.068720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8rjp\" (UniqueName: \"kubernetes.io/projected/baa58ad7-2905-476d-8941-0dc02e3bad75-kube-api-access-t8rjp\") pod \"kube-storage-version-migrator-operator-7658d9b749-tdnk9\" (UID: \"baa58ad7-2905-476d-8941-0dc02e3bad75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.068846 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.068777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-config\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:33.068846 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.068797    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f983cf45-a87a-48d4-a927-2e70765fa9f7-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ppp7n\" (UID: \"f983cf45-a87a-48d4-a927-2e70765fa9f7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.068947 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.068840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmx8q\" (UniqueName: \"kubernetes.io/projected/f983cf45-a87a-48d4-a927-2e70765fa9f7-kube-api-access-tmx8q\") pod \"service-ca-operator-5bcbc94c78-ppp7n\" (UID: \"f983cf45-a87a-48d4-a927-2e70765fa9f7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.068947 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.068877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:33.069012 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.068945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhfzl\" (UniqueName: \"kubernetes.io/projected/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-kube-api-access-mhfzl\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:33.069012 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.068975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6txz9\" (UniqueName: \"kubernetes.io/projected/7076c5de-674d-45a7-b1d1-6c658acd9298-kube-api-access-6txz9\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:33.069012 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:33.069125 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpg6v\" (UniqueName: \"kubernetes.io/projected/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-kube-api-access-xpg6v\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:33.069125 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069096    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:33.069200 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-serving-cert\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:33.069200 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c2b0549-6cbe-42d0-a45d-ee858519c674-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:33.069283 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/baa58ad7-2905-476d-8941-0dc02e3bad75-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tdnk9\" (UID: \"baa58ad7-2905-476d-8941-0dc02e3bad75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.069283 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f983cf45-a87a-48d4-a927-2e70765fa9f7-config\") pod \"service-ca-operator-5bcbc94c78-ppp7n\" (UID: \"f983cf45-a87a-48d4-a927-2e70765fa9f7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.069283 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:33.069431 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-trusted-ca\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:33.069431 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa58ad7-2905-476d-8941-0dc02e3bad75-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tdnk9\" (UID: \"baa58ad7-2905-476d-8941-0dc02e3bad75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.069521 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.069502    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-config\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:33.070052 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.070035    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-trusted-ca\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:33.071386 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.071370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-serving-cert\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:33.077754 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.077737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhfzl\" (UniqueName: \"kubernetes.io/projected/05ff7f7e-fffb-4098-b6ca-a1b04622b4bc-kube-api-access-mhfzl\") pod \"console-operator-565b7b569d-26vr8\" (UID: \"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc\") " pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:33.105075 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.105050    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:33.117040 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.117022    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf"
Jul 17 18:55:33.125196 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.125175    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx"
Jul 17 18:55:33.135356 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.135339    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-pk4cb"
Jul 17 18:55:33.170104 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f983cf45-a87a-48d4-a927-2e70765fa9f7-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ppp7n\" (UID: \"f983cf45-a87a-48d4-a927-2e70765fa9f7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.170202 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmx8q\" (UniqueName: \"kubernetes.io/projected/f983cf45-a87a-48d4-a927-2e70765fa9f7-kube-api-access-tmx8q\") pod \"service-ca-operator-5bcbc94c78-ppp7n\" (UID: \"f983cf45-a87a-48d4-a927-2e70765fa9f7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.170202 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170130    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:33.170431 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.170412    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:33.170500 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txz9\" (UniqueName: \"kubernetes.io/projected/7076c5de-674d-45a7-b1d1-6c658acd9298-kube-api-access-6txz9\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:33.170500 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.170477    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls podName:2d3fd2f0-0c3b-456b-ba0b-fcec148d229d nodeName:}" failed. No retries permitted until 2026-07-17 18:55:33.670459959 +0000 UTC m=+45.411212747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5qzqm" (UID: "2d3fd2f0-0c3b-456b-ba0b-fcec148d229d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:33.170624 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170508    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:33.170624 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpg6v\" (UniqueName: \"kubernetes.io/projected/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-kube-api-access-xpg6v\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:33.170624 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170586    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:33.170776 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c2b0549-6cbe-42d0-a45d-ee858519c674-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:33.170776 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170674    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/baa58ad7-2905-476d-8941-0dc02e3bad75-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tdnk9\" (UID: \"baa58ad7-2905-476d-8941-0dc02e3bad75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.170776 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170703    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f983cf45-a87a-48d4-a927-2e70765fa9f7-config\") pod \"service-ca-operator-5bcbc94c78-ppp7n\" (UID: \"f983cf45-a87a-48d4-a927-2e70765fa9f7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.170776 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:33.170985 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa58ad7-2905-476d-8941-0dc02e3bad75-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tdnk9\" (UID: \"baa58ad7-2905-476d-8941-0dc02e3bad75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.170985 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.170837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8rjp\" (UniqueName: \"kubernetes.io/projected/baa58ad7-2905-476d-8941-0dc02e3bad75-kube-api-access-t8rjp\") pod \"kube-storage-version-migrator-operator-7658d9b749-tdnk9\" (UID: \"baa58ad7-2905-476d-8941-0dc02e3bad75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.171375 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.171353    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 18:55:33.171624 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.171580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f983cf45-a87a-48d4-a927-2e70765fa9f7-config\") pod \"service-ca-operator-5bcbc94c78-ppp7n\" (UID: \"f983cf45-a87a-48d4-a927-2e70765fa9f7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.171745 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.171408    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c2b0549-6cbe-42d0-a45d-ee858519c674-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:33.171745 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.171438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:33.171745 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.171354    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/baa58ad7-2905-476d-8941-0dc02e3bad75-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tdnk9\" (UID: \"baa58ad7-2905-476d-8941-0dc02e3bad75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.171745 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.171425    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 18:55:33.171745 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.171623    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert podName:6c2b0549-6cbe-42d0-a45d-ee858519c674 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:33.671590935 +0000 UTC m=+45.412343734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-bnb98" (UID: "6c2b0549-6cbe-42d0-a45d-ee858519c674") : secret "networking-console-plugin-cert" not found
Jul 17 18:55:33.171745 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.171717    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls podName:7076c5de-674d-45a7-b1d1-6c658acd9298 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:33.671700953 +0000 UTC m=+45.412453742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2drz8" (UID: "7076c5de-674d-45a7-b1d1-6c658acd9298") : secret "samples-operator-tls" not found
Jul 17 18:55:33.173048 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.173027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f983cf45-a87a-48d4-a927-2e70765fa9f7-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ppp7n\" (UID: \"f983cf45-a87a-48d4-a927-2e70765fa9f7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.173581 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.173563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa58ad7-2905-476d-8941-0dc02e3bad75-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tdnk9\" (UID: \"baa58ad7-2905-476d-8941-0dc02e3bad75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.184267 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.184161    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8rjp\" (UniqueName: \"kubernetes.io/projected/baa58ad7-2905-476d-8941-0dc02e3bad75-kube-api-access-t8rjp\") pod \"kube-storage-version-migrator-operator-7658d9b749-tdnk9\" (UID: \"baa58ad7-2905-476d-8941-0dc02e3bad75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.184267 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.184222    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmx8q\" (UniqueName: \"kubernetes.io/projected/f983cf45-a87a-48d4-a927-2e70765fa9f7-kube-api-access-tmx8q\") pod \"service-ca-operator-5bcbc94c78-ppp7n\" (UID: \"f983cf45-a87a-48d4-a927-2e70765fa9f7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.184574 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.184556    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6txz9\" (UniqueName: \"kubernetes.io/projected/7076c5de-674d-45a7-b1d1-6c658acd9298-kube-api-access-6txz9\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:33.185358 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.184836    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpg6v\" (UniqueName: \"kubernetes.io/projected/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-kube-api-access-xpg6v\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:33.186211 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.186155    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:33.249746 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.249504    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:33.280004 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.279926    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"
Jul 17 18:55:33.290687 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.288325    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf"]
Jul 17 18:55:33.290687 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.288685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:33.290997 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:33.290975    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047a4f78_4729_4a68_95a8_cfe61cec503f.slice/crio-c09ca8ede8dafdebb918369e28b5d89f7f714b8feafbac955bacbf0571598ada WatchSource:0}: Error finding container c09ca8ede8dafdebb918369e28b5d89f7f714b8feafbac955bacbf0571598ada: Status 404 returned error can't find the container with id c09ca8ede8dafdebb918369e28b5d89f7f714b8feafbac955bacbf0571598ada
Jul 17 18:55:33.304528 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.304498    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx"]
Jul 17 18:55:33.311785 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:33.311753    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0bb0ce_9178_4b58_9732_37e2b8795825.slice/crio-55e47d88b4da095b1f08c6009dd26eb61e071c594417902da769b8fa83959dc6 WatchSource:0}: Error finding container 55e47d88b4da095b1f08c6009dd26eb61e071c594417902da769b8fa83959dc6: Status 404 returned error can't find the container with id 55e47d88b4da095b1f08c6009dd26eb61e071c594417902da769b8fa83959dc6
Jul 17 18:55:33.344665 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.344635    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"
Jul 17 18:55:33.353567 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.353522    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-pk4cb"]
Jul 17 18:55:33.356924 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:33.356905    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5528a224_30ce_44ce_8f02_d15b9eadc6f0.slice/crio-d11da1ad2c208e824a097e841f18416220922dda777aaf3bdd3ba0866b6c9b2e WatchSource:0}: Error finding container d11da1ad2c208e824a097e841f18416220922dda777aaf3bdd3ba0866b6c9b2e: Status 404 returned error can't find the container with id d11da1ad2c208e824a097e841f18416220922dda777aaf3bdd3ba0866b6c9b2e
Jul 17 18:55:33.421516 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.421386    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-26vr8"]
Jul 17 18:55:33.423921 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:33.423894    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ff7f7e_fffb_4098_b6ca_a1b04622b4bc.slice/crio-3b908c643df5fd2c52bd6711b9a1a1e9f4db7c0e9d7b1152e76b7c5c32d9e53b WatchSource:0}: Error finding container 3b908c643df5fd2c52bd6711b9a1a1e9f4db7c0e9d7b1152e76b7c5c32d9e53b: Status 404 returned error can't find the container with id 3b908c643df5fd2c52bd6711b9a1a1e9f4db7c0e9d7b1152e76b7c5c32d9e53b
Jul 17 18:55:33.438742 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.438715    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9"]
Jul 17 18:55:33.441482 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:33.441454    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa58ad7_2905_476d_8941_0dc02e3bad75.slice/crio-bc9982f1c0a4af9db46911613ae44e0e9aab132c2c3ab01a9038a8b2a54b97d0 WatchSource:0}: Error finding container bc9982f1c0a4af9db46911613ae44e0e9aab132c2c3ab01a9038a8b2a54b97d0: Status 404 returned error can't find the container with id bc9982f1c0a4af9db46911613ae44e0e9aab132c2c3ab01a9038a8b2a54b97d0
Jul 17 18:55:33.474542 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.474506    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:33.474869 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.474617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:33.474869 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.474759    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:34.474734889 +0000 UTC m=+46.215487693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : configmap references non-existent config key: service-ca.crt
Jul 17 18:55:33.474869 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.474766    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 18:55:33.474869 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.474844    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:34.474826921 +0000 UTC m=+46.215579709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : secret "router-metrics-certs-default" not found
Jul 17 18:55:33.503717 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.503691    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n"]
Jul 17 18:55:33.506303 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:33.506272    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf983cf45_a87a_48d4_a927_2e70765fa9f7.slice/crio-7c43c97e4b72c871f84fba38d73a0f0ba99c4673330f4df95ef7a04c7c921ec9 WatchSource:0}: Error finding container 7c43c97e4b72c871f84fba38d73a0f0ba99c4673330f4df95ef7a04c7c921ec9: Status 404 returned error can't find the container with id 7c43c97e4b72c871f84fba38d73a0f0ba99c4673330f4df95ef7a04c7c921ec9
Jul 17 18:55:33.676328 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.676282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:33.676508 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.676384    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:33.676508 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.676445    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 18:55:33.676508 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:33.676461    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:33.676508 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.676485    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:33.676508 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.676507    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls podName:7076c5de-674d-45a7-b1d1-6c658acd9298 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:34.676489232 +0000 UTC m=+46.417242023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2drz8" (UID: "7076c5de-674d-45a7-b1d1-6c658acd9298") : secret "samples-operator-tls" not found
Jul 17 18:55:33.676700 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.676543    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 18:55:33.676700 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.676547    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls podName:2d3fd2f0-0c3b-456b-ba0b-fcec148d229d nodeName:}" failed. No retries permitted until 2026-07-17 18:55:34.676527978 +0000 UTC m=+46.417280768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5qzqm" (UID: "2d3fd2f0-0c3b-456b-ba0b-fcec148d229d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:33.676700 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:33.676590    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert podName:6c2b0549-6cbe-42d0-a45d-ee858519c674 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:34.676579224 +0000 UTC m=+46.417332016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-bnb98" (UID: "6c2b0549-6cbe-42d0-a45d-ee858519c674") : secret "networking-console-plugin-cert" not found
Jul 17 18:55:34.047421 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.047343    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pk4cb" event={"ID":"5528a224-30ce-44ce-8f02-d15b9eadc6f0","Type":"ContainerStarted","Data":"d11da1ad2c208e824a097e841f18416220922dda777aaf3bdd3ba0866b6c9b2e"}
Jul 17 18:55:34.049086 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.049053    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9" event={"ID":"baa58ad7-2905-476d-8941-0dc02e3bad75","Type":"ContainerStarted","Data":"bc9982f1c0a4af9db46911613ae44e0e9aab132c2c3ab01a9038a8b2a54b97d0"}
Jul 17 18:55:34.050541 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.050479    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx" event={"ID":"ae0bb0ce-9178-4b58-9732-37e2b8795825","Type":"ContainerStarted","Data":"55e47d88b4da095b1f08c6009dd26eb61e071c594417902da769b8fa83959dc6"}
Jul 17 18:55:34.052374 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.052349    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf" event={"ID":"047a4f78-4729-4a68-95a8-cfe61cec503f","Type":"ContainerStarted","Data":"c09ca8ede8dafdebb918369e28b5d89f7f714b8feafbac955bacbf0571598ada"}
Jul 17 18:55:34.055324 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.055263    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n" event={"ID":"f983cf45-a87a-48d4-a927-2e70765fa9f7","Type":"ContainerStarted","Data":"7c43c97e4b72c871f84fba38d73a0f0ba99c4673330f4df95ef7a04c7c921ec9"}
Jul 17 18:55:34.056713 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.056688    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-26vr8" event={"ID":"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc","Type":"ContainerStarted","Data":"3b908c643df5fd2c52bd6711b9a1a1e9f4db7c0e9d7b1152e76b7c5c32d9e53b"}
Jul 17 18:55:34.485037 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.484993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:34.485214 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.485074    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:34.485277 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:34.485248    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 18:55:34.485331 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:34.485316    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:36.485294134 +0000 UTC m=+48.226046942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : secret "router-metrics-certs-default" not found
Jul 17 18:55:34.485780 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:34.485758    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:36.485739797 +0000 UTC m=+48.226492590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : configmap references non-existent config key: service-ca.crt
Jul 17 18:55:34.687770 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.687736    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:34.687965 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.687847    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:34.687965 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:34.687904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:34.688084 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:34.688047    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 18:55:34.688137 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:34.688108    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert podName:6c2b0549-6cbe-42d0-a45d-ee858519c674 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:36.688090703 +0000 UTC m=+48.428843508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-bnb98" (UID: "6c2b0549-6cbe-42d0-a45d-ee858519c674") : secret "networking-console-plugin-cert" not found
Jul 17 18:55:34.688491 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:34.688471    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 18:55:34.688577 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:34.688523    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls podName:7076c5de-674d-45a7-b1d1-6c658acd9298 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:36.68851256 +0000 UTC m=+48.429265347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2drz8" (UID: "7076c5de-674d-45a7-b1d1-6c658acd9298") : secret "samples-operator-tls" not found
Jul 17 18:55:34.688671 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:34.688595    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:34.688671 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:34.688641    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls podName:2d3fd2f0-0c3b-456b-ba0b-fcec148d229d nodeName:}" failed. No retries permitted until 2026-07-17 18:55:36.688633513 +0000 UTC m=+48.429386303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5qzqm" (UID: "2d3fd2f0-0c3b-456b-ba0b-fcec148d229d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:36.502855 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:36.502825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:36.503280 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:36.502889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:36.503280 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:36.503009    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 18:55:36.503280 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:36.503018    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:40.502998285 +0000 UTC m=+52.243751096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : configmap references non-existent config key: service-ca.crt
Jul 17 18:55:36.503280 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:36.503085    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:40.50306847 +0000 UTC m=+52.243821260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : secret "router-metrics-certs-default" not found
Jul 17 18:55:36.704258 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:36.704229    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:36.704399 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:36.704279    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:36.704399 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:36.704323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:36.704399 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:36.704373    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:36.704517 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:36.704417    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 18:55:36.704517 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:36.704422    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 18:55:36.704517 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:36.704431    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls podName:2d3fd2f0-0c3b-456b-ba0b-fcec148d229d nodeName:}" failed. No retries permitted until 2026-07-17 18:55:40.704417536 +0000 UTC m=+52.445170326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5qzqm" (UID: "2d3fd2f0-0c3b-456b-ba0b-fcec148d229d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:36.704517 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:36.704478    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls podName:7076c5de-674d-45a7-b1d1-6c658acd9298 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:40.704466679 +0000 UTC m=+52.445219469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2drz8" (UID: "7076c5de-674d-45a7-b1d1-6c658acd9298") : secret "samples-operator-tls" not found
Jul 17 18:55:36.704517 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:36.704488    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert podName:6c2b0549-6cbe-42d0-a45d-ee858519c674 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:40.704482904 +0000 UTC m=+52.445235691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-bnb98" (UID: "6c2b0549-6cbe-42d0-a45d-ee858519c674") : secret "networking-console-plugin-cert" not found
Jul 17 18:55:38.179239 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:38.179196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:38.235583 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:38.235553    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:39.074134 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:39.074104    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx" event={"ID":"ae0bb0ce-9178-4b58-9732-37e2b8795825","Type":"ContainerStarted","Data":"2b1def1b959d2db85ec3e6dc66f5f9896197613510c8e1e1782760174781b677"}
Jul 17 18:55:39.091765 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:39.091715    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h7sgx" podStartSLOduration=1.513333114 podStartE2EDuration="7.091697031s" totalImagesPullingTime="5.578363917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:39.090767582 +0000 UTC m=+50.831520392" watchObservedRunningTime="2026-07-17 18:55:39.091697031 +0000 UTC m=+50.832449837"
Jul 17 18:55:39.185351 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:39.185326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:39.289773 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:39.289709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:40.079023 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.078992    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf" event={"ID":"047a4f78-4729-4a68-95a8-cfe61cec503f","Type":"ContainerStarted","Data":"816c8dc5343e33caef0880e2ed6a07fc4b6c9fe7e56e0ab03dde7c1f9354ffab"}
Jul 17 18:55:40.080764 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.080739    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n" event={"ID":"f983cf45-a87a-48d4-a927-2e70765fa9f7","Type":"ContainerStarted","Data":"5df93e93850d0e15ca766dc139de896483cd029466058b4d5ad6ccc111a76ad2"}
Jul 17 18:55:40.082944 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.082926    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/0.log"
Jul 17 18:55:40.083057 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.082965    2558 generic.go:356] "Generic (PLEG): container finished" podID="05ff7f7e-fffb-4098-b6ca-a1b04622b4bc" containerID="a737c6f250e841ec473ce017217aef3b95835afacb167a3b107f02101ff8f000" exitCode=255
Jul 17 18:55:40.083119 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.083056    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-26vr8" event={"ID":"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc","Type":"ContainerDied","Data":"a737c6f250e841ec473ce017217aef3b95835afacb167a3b107f02101ff8f000"}
Jul 17 18:55:40.083235 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.083219    2558 scope.go:117] "RemoveContainer" containerID="a737c6f250e841ec473ce017217aef3b95835afacb167a3b107f02101ff8f000"
Jul 17 18:55:40.084791 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.084753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pk4cb" event={"ID":"5528a224-30ce-44ce-8f02-d15b9eadc6f0","Type":"ContainerStarted","Data":"0892ddc39a88093a9c8602213afe539dfaa2109aa104f9b83e5c3b92b558dfa0"}
Jul 17 18:55:40.098059 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.098015    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-76rxf" podStartSLOduration=2.444406223 podStartE2EDuration="8.097998633s" totalImagesPullingTime="5.65359241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:40.097437975 +0000 UTC m=+51.838190785" watchObservedRunningTime="2026-07-17 18:55:40.097998633 +0000 UTC m=+51.838751444"
Jul 17 18:55:40.118708 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.118664    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-pk4cb" podStartSLOduration=2.541184725 podStartE2EDuration="8.118648976s" totalImagesPullingTime="5.577464251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:40.118206979 +0000 UTC m=+51.858959789" watchObservedRunningTime="2026-07-17 18:55:40.118648976 +0000 UTC m=+51.859401786"
Jul 17 18:55:40.159898 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.159853    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n" podStartSLOduration=2.730401782 podStartE2EDuration="8.159835043s" totalImagesPullingTime="5.429433261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:40.158285697 +0000 UTC m=+51.899038506" watchObservedRunningTime="2026-07-17 18:55:40.159835043 +0000 UTC m=+51.900587857"
Jul 17 18:55:40.428425 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.428394    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:40.515831 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.515751    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fqwzr"]
Jul 17 18:55:40.516051 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.516022    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:40.533681 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.533655    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.538146 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.538121    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 18:55:40.538300 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.538203    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d9hlx\""
Jul 17 18:55:40.538449 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.538431    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 18:55:40.538875 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.538859    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fqwzr"]
Jul 17 18:55:40.540116 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.540080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:40.540236 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.540153    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:40.540236 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.540193    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:48.540172412 +0000 UTC m=+60.280925218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : configmap references non-existent config key: service-ca.crt
Jul 17 18:55:40.540363 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.540249    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 18:55:40.540363 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.540298    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:55:48.540281445 +0000 UTC m=+60.281034252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : secret "router-metrics-certs-default" not found
Jul 17 18:55:40.641015 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.640978    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh2md\" (UniqueName: \"kubernetes.io/projected/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-api-access-gh2md\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.641198 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.641041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.641198 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.641093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec676bf-440e-46c4-9ec3-491d8eb3d022-data-volume\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.641198 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.641162    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ec676bf-440e-46c4-9ec3-491d8eb3d022-crio-socket\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.641359 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.641234    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.642561 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.642485    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:40.742246 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:40.742365 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742267    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ec676bf-440e-46c4-9ec3-491d8eb3d022-crio-socket\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.742365 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:40.742365 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742356    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ec676bf-440e-46c4-9ec3-491d8eb3d022-crio-socket\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.742468 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742380    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 18:55:40.742468 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742380    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:40.742468 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742400    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.742468 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742438    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls podName:2d3fd2f0-0c3b-456b-ba0b-fcec148d229d nodeName:}" failed. No retries permitted until 2026-07-17 18:55:48.742420621 +0000 UTC m=+60.483173423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5qzqm" (UID: "2d3fd2f0-0c3b-456b-ba0b-fcec148d229d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:40.742468 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742457    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert podName:6c2b0549-6cbe-42d0-a45d-ee858519c674 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:48.742448449 +0000 UTC m=+60.483201235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-bnb98" (UID: "6c2b0549-6cbe-42d0-a45d-ee858519c674") : secret "networking-console-plugin-cert" not found
Jul 17 18:55:40.742644 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742479    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:40.742644 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:40.742644 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742520    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:41.242507361 +0000 UTC m=+52.983260147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:40.742644 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742558    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 18:55:40.742644 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh2md\" (UniqueName: \"kubernetes.io/projected/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-api-access-gh2md\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.742644 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742590    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls podName:7076c5de-674d-45a7-b1d1-6c658acd9298 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:48.742580314 +0000 UTC m=+60.483333104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2drz8" (UID: "7076c5de-674d-45a7-b1d1-6c658acd9298") : secret "samples-operator-tls" not found
Jul 17 18:55:40.742817 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.742817 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742700    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec676bf-440e-46c4-9ec3-491d8eb3d022-data-volume\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.742817 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742747    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 18:55:40.742817 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:40.742787    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:41.24277389 +0000 UTC m=+52.983526699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : configmap "kube-rbac-proxy" not found
Jul 17 18:55:40.742988 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.742973    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ec676bf-440e-46c4-9ec3-491d8eb3d022-data-volume\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:40.751285 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:40.751261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh2md\" (UniqueName: \"kubernetes.io/projected/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-api-access-gh2md\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:41.044309 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.044280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:41.044435 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.044399    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:41.044435 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.044414    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:55:41.044504 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.044461    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls podName:e9ff6ec0-3a7e-4e0e-969c-a2619d47509a nodeName:}" failed. No retries permitted until 2026-07-17 18:55:57.04444862 +0000 UTC m=+68.785201406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls") pod "dns-default-5bl2v" (UID: "e9ff6ec0-3a7e-4e0e-969c-a2619d47509a") : secret "dns-default-metrics-tls" not found
Jul 17 18:55:41.044504 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.044482    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:55:41.044504 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.044492    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bfbf8569-26gc9: secret "image-registry-tls" not found
Jul 17 18:55:41.044615 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.044527    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls podName:b248cdbd-a918-4462-a36b-8b7bdd138db1 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:57.044515592 +0000 UTC m=+68.785268379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls") pod "image-registry-8bfbf8569-26gc9" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1") : secret "image-registry-tls" not found
Jul 17 18:55:41.092134 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.092111    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 18:55:41.092618 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.092583    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/0.log"
Jul 17 18:55:41.092682 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.092649    2558 generic.go:356] "Generic (PLEG): container finished" podID="05ff7f7e-fffb-4098-b6ca-a1b04622b4bc" containerID="fc372bc9ad1914277c54f853b6ae3477282a070d8572d1be021f3811fa422aee" exitCode=255
Jul 17 18:55:41.092761 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.092739    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-26vr8" event={"ID":"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc","Type":"ContainerDied","Data":"fc372bc9ad1914277c54f853b6ae3477282a070d8572d1be021f3811fa422aee"}
Jul 17 18:55:41.092833 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.092821    2558 scope.go:117] "RemoveContainer" containerID="a737c6f250e841ec473ce017217aef3b95835afacb167a3b107f02101ff8f000"
Jul 17 18:55:41.093328 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.093307    2558 scope.go:117] "RemoveContainer" containerID="fc372bc9ad1914277c54f853b6ae3477282a070d8572d1be021f3811fa422aee"
Jul 17 18:55:41.093463 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.093441    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-26vr8_openshift-console-operator(05ff7f7e-fffb-4098-b6ca-a1b04622b4bc)\"" pod="openshift-console-operator/console-operator-565b7b569d-26vr8" podUID="05ff7f7e-fffb-4098-b6ca-a1b04622b4bc"
Jul 17 18:55:41.169946 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.169925    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:41.246178 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.246152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:41.246260 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.246246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:41.246311 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.246281    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:41.246347 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.246327    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:42.246313682 +0000 UTC m=+53.987066484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:41.246347 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.246332    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 18:55:41.246414 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:41.246364    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:42.246354514 +0000 UTC m=+53.987107301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : configmap "kube-rbac-proxy" not found
Jul 17 18:55:41.250523 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.250503    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:41.439594 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.439570    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:41.540174 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:41.540153    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:42.097479 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.097452    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 18:55:42.097852 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.097836    2558 scope.go:117] "RemoveContainer" containerID="fc372bc9ad1914277c54f853b6ae3477282a070d8572d1be021f3811fa422aee"
Jul 17 18:55:42.098026 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:42.098006    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-26vr8_openshift-console-operator(05ff7f7e-fffb-4098-b6ca-a1b04622b4bc)\"" pod="openshift-console-operator/console-operator-565b7b569d-26vr8" podUID="05ff7f7e-fffb-4098-b6ca-a1b04622b4bc"
Jul 17 18:55:42.150820 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.150791    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:42.247938 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.247915    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:42.254838 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.254812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:42.254923 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:42.254906    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 18:55:42.254958 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.254926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:42.254958 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:42.254955    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:44.254943395 +0000 UTC m=+55.995696181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : configmap "kube-rbac-proxy" not found
Jul 17 18:55:42.255024 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:42.255009    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:42.255086 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:42.255077    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:44.255060769 +0000 UTC m=+55.995813564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:42.291649 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.291629    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rxt25_0afd6108-c5dc-4376-ad7c-a8ed05fb69ac/dns-node-resolver/0.log"
Jul 17 18:55:42.348252 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.348193    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:42.779357 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.779293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:42.842028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.842009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:42.891439 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:42.891425    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4s9r8_e418ccff-ee04-4dad-bbd2-719e05a7f03d/node-ca/0.log"
Jul 17 18:55:43.157758 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:43.157737    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:43.223830 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:43.223803    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:43.249967 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:43.249950    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:43.250054 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:43.249991    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:55:43.250289 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:43.250277    2558 scope.go:117] "RemoveContainer" containerID="fc372bc9ad1914277c54f853b6ae3477282a070d8572d1be021f3811fa422aee"
Jul 17 18:55:43.250430 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:43.250412    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-26vr8_openshift-console-operator(05ff7f7e-fffb-4098-b6ca-a1b04622b4bc)\"" pod="openshift-console-operator/console-operator-565b7b569d-26vr8" podUID="05ff7f7e-fffb-4098-b6ca-a1b04622b4bc"
Jul 17 18:55:43.293241 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:43.293217    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:43.690759 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:43.690736    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dtwgf_efa9c633-2f06-4ea2-8fa3-3b4b02b9809b/serve-healthcheck-canary/0.log"
Jul 17 18:55:43.771185 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:43.771150    2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fb0f1b4b551d0c75be52aba935b78b3f40941eb96ce7697514161f2793c0042e: reading manifest sha256:b2288cc51bda9870eb489be5e40666b5ef867c8465728f21abea135d763736d3 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fb0f1b4b551d0c75be52aba935b78b3f40941eb96ce7697514161f2793c0042e"
Jul 17 18:55:43.771352 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:43.771303    2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-storage-version-migrator-operator start failed in pod kube-storage-version-migrator-operator-7658d9b749-tdnk9_openshift-kube-storage-version-migrator-operator(baa58ad7-2905-476d-8941-0dc02e3bad75): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fb0f1b4b551d0c75be52aba935b78b3f40941eb96ce7697514161f2793c0042e: reading manifest sha256:b2288cc51bda9870eb489be5e40666b5ef867c8465728f21abea135d763736d3 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 17 18:55:43.771427 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:43.771353    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-storage-version-migrator-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fb0f1b4b551d0c75be52aba935b78b3f40941eb96ce7697514161f2793c0042e: reading manifest sha256:b2288cc51bda9870eb489be5e40666b5ef867c8465728f21abea135d763736d3 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9" podUID="baa58ad7-2905-476d-8941-0dc02e3bad75"
Jul 17 18:55:44.105305 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:44.105270    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-storage-version-migrator-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fb0f1b4b551d0c75be52aba935b78b3f40941eb96ce7697514161f2793c0042e\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fb0f1b4b551d0c75be52aba935b78b3f40941eb96ce7697514161f2793c0042e: reading manifest sha256:b2288cc51bda9870eb489be5e40666b5ef867c8465728f21abea135d763736d3 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9" podUID="baa58ad7-2905-476d-8941-0dc02e3bad75"
Jul 17 18:55:44.274370 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:44.274333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:44.274533 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:44.274465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:44.274533 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:44.274495    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:44.274628 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:44.274536    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 18:55:44.274628 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:44.274579    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:48.274557575 +0000 UTC m=+60.015310369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:44.274628 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:44.274593    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:48.274587036 +0000 UTC m=+60.015339824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : configmap "kube-rbac-proxy" not found
Jul 17 18:55:46.783147 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:46.783115    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:46.930116 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:46.930084    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:47.036536 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:47.036469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:47.134808 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:47.134778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:47.229919 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:47.229890    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:47.340135 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:47.340108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:47.473492 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:47.473461    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:48.309224 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.309186    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:48.309676 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.309286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:48.309676 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.309330    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:48.309676 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.309366    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 18:55:48.309676 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.309393    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:56.309377249 +0000 UTC m=+68.050130035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:48.309676 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.309410    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:55:56.309399177 +0000 UTC m=+68.050151965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : configmap "kube-rbac-proxy" not found
Jul 17 18:55:48.474105 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.474077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:48.612247 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.612218    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:48.612434 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.612277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:55:48.612434 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.612363    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:56:04.612346881 +0000 UTC m=+76.353099668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : configmap references non-existent config key: service-ca.crt
Jul 17 18:55:48.612434 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.612366    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 18:55:48.612434 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.612405    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs podName:d08e0539-ce5f-4636-93ed-6fd344b871cc nodeName:}" failed. No retries permitted until 2026-07-17 18:56:04.612394857 +0000 UTC m=+76.353147644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs") pod "router-default-75d9b569c6-grjnm" (UID: "d08e0539-ce5f-4636-93ed-6fd344b871cc") : secret "router-metrics-certs-default" not found
Jul 17 18:55:48.814194 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.814149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:48.814394 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.814253    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:55:48.814394 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.814292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:55:48.814509 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.814395    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 18:55:48.814509 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.814406    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:48.814509 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.814454    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert podName:6c2b0549-6cbe-42d0-a45d-ee858519c674 nodeName:}" failed. No retries permitted until 2026-07-17 18:56:04.814435797 +0000 UTC m=+76.555188585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-bnb98" (UID: "6c2b0549-6cbe-42d0-a45d-ee858519c674") : secret "networking-console-plugin-cert" not found
Jul 17 18:55:48.814509 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:48.814469    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls podName:2d3fd2f0-0c3b-456b-ba0b-fcec148d229d nodeName:}" failed. No retries permitted until 2026-07-17 18:56:04.814461418 +0000 UTC m=+76.555214206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5qzqm" (UID: "2d3fd2f0-0c3b-456b-ba0b-fcec148d229d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 18:55:48.816687 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.816658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7076c5de-674d-45a7-b1d1-6c658acd9298-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2drz8\" (UID: \"7076c5de-674d-45a7-b1d1-6c658acd9298\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:48.876853 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.876771    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:48.960745 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.960718    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lvb59\""
Jul 17 18:55:48.968997 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:48.968980    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"
Jul 17 18:55:49.077654 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:49.077627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:49.092730 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:49.092702    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8"]
Jul 17 18:55:49.286545 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:49.286513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:49.681597 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:49.681559    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:50.077378 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:50.077349    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:50.124524 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:50.124485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8" event={"ID":"7076c5de-674d-45a7-b1d1-6c658acd9298","Type":"ContainerStarted","Data":"0d3f7b724540e6d6b5a1b0e9f50099f0655316dd87d19820b6254db30db6d026"}
Jul 17 18:55:50.477816 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:50.477711    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:50.567144 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:50.567109    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:50.870898 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:50.870860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:51.014956 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:51.014927    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2cbz"
Jul 17 18:55:51.180623 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:51.180502    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:51.268315 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:51.268287    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:51.369449 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:51.369429    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:51.480589 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:51.480564    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:51.681694 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:51.681662    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:52.080093 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:52.080057    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:52.133753 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:52.133720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8" event={"ID":"7076c5de-674d-45a7-b1d1-6c658acd9298","Type":"ContainerStarted","Data":"0f73b2105d42753f455bacb58482357f1833b17b1e86fd27e7385ab959da38f7"}
Jul 17 18:55:52.133902 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:52.133796    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8" event={"ID":"7076c5de-674d-45a7-b1d1-6c658acd9298","Type":"ContainerStarted","Data":"6ac07f4ec3035c3c23c478a8648a66c370d15141efe4c1d70283f33e0d58fb27"}
Jul 17 18:55:52.152310 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:52.152268    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2drz8" podStartSLOduration=18.057310045 podStartE2EDuration="20.152245469s" totalImagesPullingTime="2.094935424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:52.152016981 +0000 UTC m=+63.892769791" watchObservedRunningTime="2026-07-17 18:55:52.152245469 +0000 UTC m=+63.892998278"
Jul 17 18:55:52.871154 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:52.871126    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:53.100382 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:53.100348    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:53.188243 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:53.188169    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:53.288945 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:53.288910    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:53.477318 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:53.477245    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:53.680499 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:53.680469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:53.878620 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:53.878576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:54.565938 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.565904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:54.566350 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.565981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:54.568455 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.568436    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 18:55:54.568514 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.568436    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 18:55:54.578721 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.578689    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81b37e7-4f8b-42e9-8af1-187f5d26cd27-original-pull-secret\") pod \"global-pull-secret-syncer-h9wdv\" (UID: \"f81b37e7-4f8b-42e9-8af1-187f5d26cd27\") " pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:54.578836 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.578693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc317da8-729e-4b00-bc8e-8694b867da64-metrics-certs\") pod \"network-metrics-daemon-8xrbc\" (UID: \"dc317da8-729e-4b00-bc8e-8694b867da64\") " pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:54.666664 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.666629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:54.669223 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.669192    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-www2d\" (UniqueName: \"kubernetes.io/projected/c429a0ee-0a90-408d-9932-8093b987145d-kube-api-access-www2d\") pod \"network-check-target-jn5nj\" (UID: \"c429a0ee-0a90-408d-9932-8093b987145d\") " pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:54.819291 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.819195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9wdv"
Jul 17 18:55:54.830453 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.830430    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bqhtg\""
Jul 17 18:55:54.834501 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.834480    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n57jp\""
Jul 17 18:55:54.838484 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.838464    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:54.843212 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.843195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xrbc"
Jul 17 18:55:54.872006 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.871860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:54.986033 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:54.986005    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h9wdv"]
Jul 17 18:55:54.988425 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:54.988401    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81b37e7_4f8b_42e9_8af1_187f5d26cd27.slice/crio-883d4ce731ccc4d0c0bea2e924948c357f06af957780a418f805728431361b72 WatchSource:0}: Error finding container 883d4ce731ccc4d0c0bea2e924948c357f06af957780a418f805728431361b72: Status 404 returned error can't find the container with id 883d4ce731ccc4d0c0bea2e924948c357f06af957780a418f805728431361b72
Jul 17 18:55:55.009747 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.009713    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8xrbc"]
Jul 17 18:55:55.012685 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:55.012661    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc317da8_729e_4b00_bc8e_8694b867da64.slice/crio-70c47b2ba745c5dd575cce2c63bf14651cd69f79c3b31a091013f52e7e009730 WatchSource:0}: Error finding container 70c47b2ba745c5dd575cce2c63bf14651cd69f79c3b31a091013f52e7e009730: Status 404 returned error can't find the container with id 70c47b2ba745c5dd575cce2c63bf14651cd69f79c3b31a091013f52e7e009730
Jul 17 18:55:55.026505 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.026481    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jn5nj"]
Jul 17 18:55:55.029118 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:55.029094    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc429a0ee_0a90_408d_9932_8093b987145d.slice/crio-7e252e4dc11cdc1e128397e71ca08d3d77d3b4ec65c8a2015bd8a6e092d4df5f WatchSource:0}: Error finding container 7e252e4dc11cdc1e128397e71ca08d3d77d3b4ec65c8a2015bd8a6e092d4df5f: Status 404 returned error can't find the container with id 7e252e4dc11cdc1e128397e71ca08d3d77d3b4ec65c8a2015bd8a6e092d4df5f
Jul 17 18:55:55.144326 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.144290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h9wdv" event={"ID":"f81b37e7-4f8b-42e9-8af1-187f5d26cd27","Type":"ContainerStarted","Data":"883d4ce731ccc4d0c0bea2e924948c357f06af957780a418f805728431361b72"}
Jul 17 18:55:55.145388 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.145366    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8xrbc" event={"ID":"dc317da8-729e-4b00-bc8e-8694b867da64","Type":"ContainerStarted","Data":"70c47b2ba745c5dd575cce2c63bf14651cd69f79c3b31a091013f52e7e009730"}
Jul 17 18:55:55.150347 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.150322    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jn5nj" event={"ID":"c429a0ee-0a90-408d-9932-8093b987145d","Type":"ContainerStarted","Data":"a4d3de1f5efd744f0b80255bfb11eff9f57bca0a538bd6cd6c7e9f064badbf7a"}
Jul 17 18:55:55.150477 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.150391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jn5nj" event={"ID":"c429a0ee-0a90-408d-9932-8093b987145d","Type":"ContainerStarted","Data":"7e252e4dc11cdc1e128397e71ca08d3d77d3b4ec65c8a2015bd8a6e092d4df5f"}
Jul 17 18:55:55.150550 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.150482    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:55:55.171956 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.171904    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jn5nj" podStartSLOduration=66.171890159 podStartE2EDuration="1m6.171890159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:55.17107495 +0000 UTC m=+66.911827746" watchObservedRunningTime="2026-07-17 18:55:55.171890159 +0000 UTC m=+66.912642968"
Jul 17 18:55:55.280786 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.280756    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:55.469241 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.469208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:55.614126 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.614099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:55.713594 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.713566    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:55.869866 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.869835    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:55.970896 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:55.970868    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:56.381227 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:56.381194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:56.381409 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:56.381297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:56.381497 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:56.381477    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:56.381571 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:55:56.381561    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls podName:4ec676bf-440e-46c4-9ec3-491d8eb3d022 nodeName:}" failed. No retries permitted until 2026-07-17 18:56:12.381540758 +0000 UTC m=+84.122293549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqwzr" (UID: "4ec676bf-440e-46c4-9ec3-491d8eb3d022") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:55:56.381801 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:56.381779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ec676bf-440e-46c4-9ec3-491d8eb3d022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:55:56.674573 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:56.674488    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:56.866435 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:56.866407    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:57.088779 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.088751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:57.088929 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.088824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:57.091517 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.091494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ff6ec0-3a7e-4e0e-969c-a2619d47509a-metrics-tls\") pod \"dns-default-5bl2v\" (UID: \"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a\") " pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:57.091676 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.091580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"image-registry-8bfbf8569-26gc9\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") " pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:57.162122 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.161512    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8xrbc" event={"ID":"dc317da8-729e-4b00-bc8e-8694b867da64","Type":"ContainerStarted","Data":"2a8aec0c71e53925efaff81dd2948f73341dd3f0030d9d35e1c9c3e665d1d2b2"}
Jul 17 18:55:57.162122 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.161579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8xrbc" event={"ID":"dc317da8-729e-4b00-bc8e-8694b867da64","Type":"ContainerStarted","Data":"fc0cb4aa9023ecce33bf79cd90051a625b391e1cfc4bf71d1ee66a9d2ff67ac3"}
Jul 17 18:55:57.178581 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.178467    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8xrbc" podStartSLOduration=67.500861518 podStartE2EDuration="1m9.178450596s" totalImagesPullingTime="1.677589078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:57.178211922 +0000 UTC m=+68.918964732" watchObservedRunningTime="2026-07-17 18:55:57.178450596 +0000 UTC m=+68.919203405"
Jul 17 18:55:57.241253 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.241224    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zbkpp\""
Jul 17 18:55:57.249493 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.249283    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:55:57.269903 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.269877    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfsnb\""
Jul 17 18:55:57.277575 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.277555    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:55:57.278593 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.278553    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:57.379534 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.379445    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:57.408887 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.408856    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8bfbf8569-26gc9"]
Jul 17 18:55:57.480637 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.480585    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:57.709699 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:57.709625    2558 scope.go:117] "RemoveContainer" containerID="fc372bc9ad1914277c54f853b6ae3477282a070d8572d1be021f3811fa422aee"
Jul 17 18:55:57.856899 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:57.856859    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb248cdbd_a918_4462_a36b_8b7bdd138db1.slice/crio-4b87549995e2c55882d71d7db56e48af6add252837dccc180f55c7a94b4a24c4 WatchSource:0}: Error finding container 4b87549995e2c55882d71d7db56e48af6add252837dccc180f55c7a94b4a24c4: Status 404 returned error can't find the container with id 4b87549995e2c55882d71d7db56e48af6add252837dccc180f55c7a94b4a24c4
Jul 17 18:55:58.167459 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:58.167423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9" event={"ID":"b248cdbd-a918-4462-a36b-8b7bdd138db1","Type":"ContainerStarted","Data":"4b87549995e2c55882d71d7db56e48af6add252837dccc180f55c7a94b4a24c4"}
Jul 17 18:55:58.515012 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:58.514927    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:59.856596 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:55:59.856568    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bl2v"]
Jul 17 18:55:59.859525 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:55:59.859492    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ff6ec0_3a7e_4e0e_969c_a2619d47509a.slice/crio-ecdd389fb05a75a5222f28f8fc3009661b79272762d1df6cc0d5e7595ce37a1e WatchSource:0}: Error finding container ecdd389fb05a75a5222f28f8fc3009661b79272762d1df6cc0d5e7595ce37a1e: Status 404 returned error can't find the container with id ecdd389fb05a75a5222f28f8fc3009661b79272762d1df6cc0d5e7595ce37a1e
Jul 17 18:56:00.058991 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.058903    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:00.177067 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.177037    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 18:56:00.177240 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.177134    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-26vr8" event={"ID":"05ff7f7e-fffb-4098-b6ca-a1b04622b4bc","Type":"ContainerStarted","Data":"53d80d67fd222a31ec7ad39fe6f7e97a6695f91725a721d3952f796c5f6d7fdf"}
Jul 17 18:56:00.177470 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.177447    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:56:00.179478 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.179440    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9" event={"ID":"b248cdbd-a918-4462-a36b-8b7bdd138db1","Type":"ContainerStarted","Data":"f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9"}
Jul 17 18:56:00.180007 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.179988    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:56:00.181418 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.181396    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bl2v" event={"ID":"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a","Type":"ContainerStarted","Data":"ecdd389fb05a75a5222f28f8fc3009661b79272762d1df6cc0d5e7595ce37a1e"}
Jul 17 18:56:00.183110 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.183068    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h9wdv" event={"ID":"f81b37e7-4f8b-42e9-8af1-187f5d26cd27","Type":"ContainerStarted","Data":"7411e9efbc8e88723f04263cc0da14e76b28940a43092227415c66b619414650"}
Jul 17 18:56:00.184693 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.184671    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9" event={"ID":"baa58ad7-2905-476d-8941-0dc02e3bad75","Type":"ContainerStarted","Data":"29a7c04e2d08d92a9475b6cec06d4025327fae5b76a5296a8da4db061ae7e944"}
Jul 17 18:56:00.197223 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.197176    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-26vr8" podStartSLOduration=22.686308708 podStartE2EDuration="28.197163897s" totalImagesPullingTime="5.510855189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:00.195363905 +0000 UTC m=+71.936116720" watchObservedRunningTime="2026-07-17 18:56:00.197163897 +0000 UTC m=+71.937916706"
Jul 17 18:56:00.218825 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.218768    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9" podStartSLOduration=71.218750637 podStartE2EDuration="1m11.218750637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:00.217960806 +0000 UTC m=+71.958713615" watchObservedRunningTime="2026-07-17 18:56:00.218750637 +0000 UTC m=+71.959503448"
Jul 17 18:56:00.234456 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.234415    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h9wdv" podStartSLOduration=66.492832465 podStartE2EDuration="1m11.234400856s" totalImagesPullingTime="4.741568391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:00.234253981 +0000 UTC m=+71.975006791" watchObservedRunningTime="2026-07-17 18:56:00.234400856 +0000 UTC m=+71.975153666"
Jul 17 18:56:00.250064 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.250018    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tdnk9" podStartSLOduration=1.974252347 podStartE2EDuration="28.250005134s" totalImagesPullingTime="26.275752787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 18:56:00.249766917 +0000 UTC m=+71.990519726" watchObservedRunningTime="2026-07-17 18:56:00.250005134 +0000 UTC m=+71.990757944"
Jul 17 18:56:00.443905 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.443876    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-26vr8"
Jul 17 18:56:00.661400 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.661356    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:00.762711 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.762615    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:00.830301 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.830272    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:00.935715 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:00.935668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:01.127189 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:01.127156    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:01.650643 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:01.650591    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:01.750102 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:01.750029    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:02.084313 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:02.084280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:02.192866 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:02.192835    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bl2v" event={"ID":"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a","Type":"ContainerStarted","Data":"57fd65997dc031733ceddcc5dd31025f646777e7edab6a27e1327e6c4c9191ef"}
Jul 17 18:56:02.193028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:02.192912    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bl2v" event={"ID":"e9ff6ec0-3a7e-4e0e-969c-a2619d47509a","Type":"ContainerStarted","Data":"59c696bac42572126e6ce06f5beb8aa4f7ee8bb6b7f05045881acfa79c52e9b8"}
Jul 17 18:56:02.193028 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:02.193009    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:56:02.223024 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:02.222980    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5bl2v" podStartSLOduration=35.584274938 podStartE2EDuration="37.222964419s" totalImagesPullingTime="1.638689481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:02.222232716 +0000 UTC m=+73.962985526" watchObservedRunningTime="2026-07-17 18:56:02.222964419 +0000 UTC m=+73.963717228"
Jul 17 18:56:02.315464 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:02.315435    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:02.519989 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:02.519919    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:02.666447 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:02.666416    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:03.136680 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:03.136649    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:03.441024 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:03.440960    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:04.660146 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.660115    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:56:04.660501 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.660160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:56:04.660719 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.660702    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08e0539-ce5f-4636-93ed-6fd344b871cc-service-ca-bundle\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:56:04.662516 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.662498    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08e0539-ce5f-4636-93ed-6fd344b871cc-metrics-certs\") pod \"router-default-75d9b569c6-grjnm\" (UID: \"d08e0539-ce5f-4636-93ed-6fd344b871cc\") " pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:56:04.862042 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.862017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:56:04.862167 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.862050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:56:04.864377 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.864354    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d3fd2f0-0c3b-456b-ba0b-fcec148d229d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5qzqm\" (UID: \"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:56:04.864458 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.864378    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c2b0549-6cbe-42d0-a45d-ee858519c674-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-bnb98\" (UID: \"6c2b0549-6cbe-42d0-a45d-ee858519c674\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:56:04.959426 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.959369    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-44gpj\""
Jul 17 18:56:04.967526 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:04.967505    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:56:05.095997 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.095976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75d9b569c6-grjnm"]
Jul 17 18:56:05.098283 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:56:05.098247    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08e0539_ce5f_4636_93ed_6fd344b871cc.slice/crio-d0acfc0763f0089506439959e3d6716748eb53acde9c29da51290ca174e24bfc WatchSource:0}: Error finding container d0acfc0763f0089506439959e3d6716748eb53acde9c29da51290ca174e24bfc: Status 404 returned error can't find the container with id d0acfc0763f0089506439959e3d6716748eb53acde9c29da51290ca174e24bfc
Jul 17 18:56:05.111064 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.111039    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pswlx\""
Jul 17 18:56:05.119718 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.119698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"
Jul 17 18:56:05.125900 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.125883    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s98zd\""
Jul 17 18:56:05.133451 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.133429    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"
Jul 17 18:56:05.206678 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.206362    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75d9b569c6-grjnm" event={"ID":"d08e0539-ce5f-4636-93ed-6fd344b871cc","Type":"ContainerStarted","Data":"8ac5496c94a901e25eb524c9ee4b1cf766bb917d7c7ecc1743b6dc78c7751583"}
Jul 17 18:56:05.206678 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.206414    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75d9b569c6-grjnm" event={"ID":"d08e0539-ce5f-4636-93ed-6fd344b871cc","Type":"ContainerStarted","Data":"d0acfc0763f0089506439959e3d6716748eb53acde9c29da51290ca174e24bfc"}
Jul 17 18:56:05.226528 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.226440    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75d9b569c6-grjnm" podStartSLOduration=33.226418309 podStartE2EDuration="33.226418309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:05.225920315 +0000 UTC m=+76.966673138" watchObservedRunningTime="2026-07-17 18:56:05.226418309 +0000 UTC m=+76.967171118"
Jul 17 18:56:05.265524 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.265494    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm"]
Jul 17 18:56:05.268894 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:56:05.268870    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3fd2f0_0c3b_456b_ba0b_fcec148d229d.slice/crio-a48b134d90cff7e3fff777e1630f2175f135086cd8ff738b505b15586d918bd0 WatchSource:0}: Error finding container a48b134d90cff7e3fff777e1630f2175f135086cd8ff738b505b15586d918bd0: Status 404 returned error can't find the container with id a48b134d90cff7e3fff777e1630f2175f135086cd8ff738b505b15586d918bd0
Jul 17 18:56:05.282038 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.282014    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98"]
Jul 17 18:56:05.284406 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:56:05.284385    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2b0549_6cbe_42d0_a45d_ee858519c674.slice/crio-06c3ab93500cb4472abc12323d08dab1947edf919ebd8902eebaede7be21f339 WatchSource:0}: Error finding container 06c3ab93500cb4472abc12323d08dab1947edf919ebd8902eebaede7be21f339: Status 404 returned error can't find the container with id 06c3ab93500cb4472abc12323d08dab1947edf919ebd8902eebaede7be21f339
Jul 17 18:56:05.968550 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.968506    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:56:05.971615 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:05.971575    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:56:06.212229 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:06.212181    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98" event={"ID":"6c2b0549-6cbe-42d0-a45d-ee858519c674","Type":"ContainerStarted","Data":"06c3ab93500cb4472abc12323d08dab1947edf919ebd8902eebaede7be21f339"}
Jul 17 18:56:06.213657 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:06.213625    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm" event={"ID":"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d","Type":"ContainerStarted","Data":"a48b134d90cff7e3fff777e1630f2175f135086cd8ff738b505b15586d918bd0"}
Jul 17 18:56:06.213828 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:06.213803    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:56:06.215215 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:06.215194    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75d9b569c6-grjnm"
Jul 17 18:56:07.219833 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:07.219734    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98" event={"ID":"6c2b0549-6cbe-42d0-a45d-ee858519c674","Type":"ContainerStarted","Data":"d36854a13c9763aa05d402ba802e42b5169eb70cb538796789498747fdd6fd41"}
Jul 17 18:56:07.237830 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:07.237774    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-bnb98" podStartSLOduration=33.667493535 podStartE2EDuration="35.237754653s" totalImagesPullingTime="1.570261118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:07.23689215 +0000 UTC m=+78.977644959" watchObservedRunningTime="2026-07-17 18:56:07.237754653 +0000 UTC m=+78.978507463"
Jul 17 18:56:09.118407 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:09.118368    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:09.216744 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:09.216684    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:09.229225 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:09.229188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm" event={"ID":"2d3fd2f0-0c3b-456b-ba0b-fcec148d229d","Type":"ContainerStarted","Data":"dcd5943b08268afcc4a7b4e536821c61f8846487799cbb75ecd33b782fb6b7c3"}
Jul 17 18:56:09.248228 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:09.248180    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5qzqm" podStartSLOduration=33.76981194 podStartE2EDuration="37.248166152s" totalImagesPullingTime="3.478354212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:09.246941848 +0000 UTC m=+80.987694657" watchObservedRunningTime="2026-07-17 18:56:09.248166152 +0000 UTC m=+80.988918960"
Jul 17 18:56:09.315886 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:09.315855    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:10.445325 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.445296    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"]
Jul 17 18:56:10.447805 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.447780    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.451151 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.451129    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 18:56:10.451670 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.451653    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 18:56:10.451779 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.451745    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 18:56:10.452017 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.451994    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 18:56:10.452133 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.452094    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 18:56:10.452286 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.452268    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 18:56:10.452377 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.452284    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 18:56:10.463592 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.463571    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"]
Jul 17 18:56:10.491679 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.491652    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8bfbf8569-26gc9"]
Jul 17 18:56:10.532966 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.532943    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c99d4ff46-kwxgq"]
Jul 17 18:56:10.534971 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.534957    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.550746 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.550719    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:10.552219 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.552196    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c99d4ff46-kwxgq"]
Jul 17 18:56:10.613715 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.613691    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-hub\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.613829 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.613729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-ca\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.613829 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.613758    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4adf247-eac6-4263-a790-5a0b40a285dd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.613937 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.613848    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.613937 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.613883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.613937 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.613908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdchc\" (UniqueName: \"kubernetes.io/projected/d4adf247-eac6-4263-a790-5a0b40a285dd-kube-api-access-tdchc\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.640013 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.639994    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:10.714441 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714387    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-ca\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.714441 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4adf247-eac6-4263-a790-5a0b40a285dd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.714441 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5779ec22-fcf5-420f-8674-47f62f4e1987-registry-tls\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.714580 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5779ec22-fcf5-420f-8674-47f62f4e1987-ca-trust-extracted\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.714634 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714570    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5779ec22-fcf5-420f-8674-47f62f4e1987-trusted-ca\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.714634 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714629    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5779ec22-fcf5-420f-8674-47f62f4e1987-registry-certificates\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.714698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5779ec22-fcf5-420f-8674-47f62f4e1987-bound-sa-token\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.714698 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714671    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5779ec22-fcf5-420f-8674-47f62f4e1987-image-registry-private-configuration\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.714812 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714700    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.714812 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714730    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5779ec22-fcf5-420f-8674-47f62f4e1987-installation-pull-secrets\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.714887 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.714887 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdchc\" (UniqueName: \"kubernetes.io/projected/d4adf247-eac6-4263-a790-5a0b40a285dd-kube-api-access-tdchc\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.714988 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct9sj\" (UniqueName: \"kubernetes.io/projected/5779ec22-fcf5-420f-8674-47f62f4e1987-kube-api-access-ct9sj\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.714988 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.714952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-hub\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.715209 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.715190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4adf247-eac6-4263-a790-5a0b40a285dd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.717054 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.717037    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-ca\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.717301 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.717283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.717387 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.717373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.717617 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.717581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d4adf247-eac6-4263-a790-5a0b40a285dd-hub\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.722762 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.722743    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdchc\" (UniqueName: \"kubernetes.io/projected/d4adf247-eac6-4263-a790-5a0b40a285dd-kube-api-access-tdchc\") pod \"cluster-proxy-proxy-agent-65cf78dbbd-qfcwc\" (UID: \"d4adf247-eac6-4263-a790-5a0b40a285dd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.741253 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.741230    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:10.767401 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.767380    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"
Jul 17 18:56:10.816114 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.816030    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5779ec22-fcf5-420f-8674-47f62f4e1987-installation-pull-secrets\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.816114 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.816074    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct9sj\" (UniqueName: \"kubernetes.io/projected/5779ec22-fcf5-420f-8674-47f62f4e1987-kube-api-access-ct9sj\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.816252 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.816144    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5779ec22-fcf5-420f-8674-47f62f4e1987-registry-tls\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.816252 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.816170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5779ec22-fcf5-420f-8674-47f62f4e1987-ca-trust-extracted\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.816252 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.816215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5779ec22-fcf5-420f-8674-47f62f4e1987-trusted-ca\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.816252 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.816245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5779ec22-fcf5-420f-8674-47f62f4e1987-registry-certificates\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.816455 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.816270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5779ec22-fcf5-420f-8674-47f62f4e1987-bound-sa-token\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.816455 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.816296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5779ec22-fcf5-420f-8674-47f62f4e1987-image-registry-private-configuration\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.817668 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.816839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5779ec22-fcf5-420f-8674-47f62f4e1987-ca-trust-extracted\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.818157 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.818123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5779ec22-fcf5-420f-8674-47f62f4e1987-registry-certificates\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.819413 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.819366    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5779ec22-fcf5-420f-8674-47f62f4e1987-image-registry-private-configuration\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.819709 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.819592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5779ec22-fcf5-420f-8674-47f62f4e1987-trusted-ca\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.820752 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.820711    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5779ec22-fcf5-420f-8674-47f62f4e1987-installation-pull-secrets\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.821338 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.821298    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5779ec22-fcf5-420f-8674-47f62f4e1987-registry-tls\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.826809 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.826758    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct9sj\" (UniqueName: \"kubernetes.io/projected/5779ec22-fcf5-420f-8674-47f62f4e1987-kube-api-access-ct9sj\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.826809 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.826805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5779ec22-fcf5-420f-8674-47f62f4e1987-bound-sa-token\") pod \"image-registry-6c99d4ff46-kwxgq\" (UID: \"5779ec22-fcf5-420f-8674-47f62f4e1987\") " pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.837817 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.837794    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:10.843718 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.843702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:10.893800 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.893765    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:10.903020 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.902998    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc"]
Jul 17 18:56:10.905372 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:56:10.905343    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4adf247_eac6_4263_a790_5a0b40a285dd.slice/crio-fafac76a73a3ae4c38cf95816866e09ab5d32440e0a97ead48d2684ccf752f2d WatchSource:0}: Error finding container fafac76a73a3ae4c38cf95816866e09ab5d32440e0a97ead48d2684ccf752f2d: Status 404 returned error can't find the container with id fafac76a73a3ae4c38cf95816866e09ab5d32440e0a97ead48d2684ccf752f2d
Jul 17 18:56:10.973673 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:10.973650    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c99d4ff46-kwxgq"]
Jul 17 18:56:10.975506 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:56:10.975485    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5779ec22_fcf5_420f_8674_47f62f4e1987.slice/crio-d1a9c9650b12cc2c798fb9b16dcdf88c0a2db73c2ca65668d175e2706fee8eba WatchSource:0}: Error finding container d1a9c9650b12cc2c798fb9b16dcdf88c0a2db73c2ca65668d175e2706fee8eba: Status 404 returned error can't find the container with id d1a9c9650b12cc2c798fb9b16dcdf88c0a2db73c2ca65668d175e2706fee8eba
Jul 17 18:56:11.237375 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:11.237293    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc" event={"ID":"d4adf247-eac6-4263-a790-5a0b40a285dd","Type":"ContainerStarted","Data":"fafac76a73a3ae4c38cf95816866e09ab5d32440e0a97ead48d2684ccf752f2d"}
Jul 17 18:56:11.238791 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:11.238759    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq" event={"ID":"5779ec22-fcf5-420f-8674-47f62f4e1987","Type":"ContainerStarted","Data":"6420c37836c692a3a82127e110ed1189788e3fb5434ebc3fb878fd02109763d1"}
Jul 17 18:56:11.238909 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:11.238830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq" event={"ID":"5779ec22-fcf5-420f-8674-47f62f4e1987","Type":"ContainerStarted","Data":"d1a9c9650b12cc2c798fb9b16dcdf88c0a2db73c2ca65668d175e2706fee8eba"}
Jul 17 18:56:11.238965 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:11.238906    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:11.271151 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:11.271104    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq" podStartSLOduration=1.271080556 podStartE2EDuration="1.271080556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:56:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:11.27055127 +0000 UTC m=+83.011304080" watchObservedRunningTime="2026-07-17 18:56:11.271080556 +0000 UTC m=+83.011833366"
Jul 17 18:56:11.409565 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:11.409529    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:11.464921 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:11.464887    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:12.197395 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:12.197370    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5bl2v"
Jul 17 18:56:12.429811 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:12.429781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:56:12.432265 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:12.432239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ec676bf-440e-46c4-9ec3-491d8eb3d022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqwzr\" (UID: \"4ec676bf-440e-46c4-9ec3-491d8eb3d022\") " pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:56:12.646514 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:12.646486    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d9hlx\""
Jul 17 18:56:12.654462 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:12.654440    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fqwzr"
Jul 17 18:56:12.784675 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:12.784652    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fqwzr"]
Jul 17 18:56:12.787247 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:56:12.787218    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec676bf_440e_46c4_9ec3_491d8eb3d022.slice/crio-6e78efaa53721bc60806d157843ee6156fa11542db86800b9084733984fb250f WatchSource:0}: Error finding container 6e78efaa53721bc60806d157843ee6156fa11542db86800b9084733984fb250f: Status 404 returned error can't find the container with id 6e78efaa53721bc60806d157843ee6156fa11542db86800b9084733984fb250f
Jul 17 18:56:13.248948 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:13.248908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqwzr" event={"ID":"4ec676bf-440e-46c4-9ec3-491d8eb3d022","Type":"ContainerStarted","Data":"6e78efaa53721bc60806d157843ee6156fa11542db86800b9084733984fb250f"}
Jul 17 18:56:13.611623 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:13.611573    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:13.679286 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:13.679254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:14.343653 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:14.343621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:14.401584 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:14.401547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:14.673225 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:14.673146    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:14.775762 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:14.775726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:16.542850 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:16.542818    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:16.609192 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:16.609150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:17.341048 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:17.341013    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:17.396619 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:17.396570    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:18.252007 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:18.251969    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:18.275193 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:18.275098    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqwzr" event={"ID":"4ec676bf-440e-46c4-9ec3-491d8eb3d022","Type":"ContainerStarted","Data":"79f1754302c750023429bf2d0a6a2e45788a392196f0470576758c95a9d98367"}
Jul 17 18:56:19.942647 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:19.942562    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:20.045397 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:20.045365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:20.146474 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:20.146405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:20.499559 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:20.499533    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:56:21.151194 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:21.151162    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:21.253702 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:21.253663    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:21.290576 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:21.290541    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqwzr" event={"ID":"4ec676bf-440e-46c4-9ec3-491d8eb3d022","Type":"ContainerStarted","Data":"20e45855e7c5e9a2d17c914e86577a18ba1291934a9f68e144cb6d77012c6eba"}
Jul 17 18:56:21.353409 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:21.353341    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:21.567138 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:21.567024    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:21.668402 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:21.668332    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:22.769656 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:22.769616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:22.873529 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:22.873492    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:23.324292 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:23.324244    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:23.400470 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:23.400432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:23.594952 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:23.594921    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:23.759852 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:23.759819    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:23.816488 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:23.816460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:26.157542 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:26.157514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jn5nj"
Jul 17 18:56:26.312229 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:26.312198    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc" event={"ID":"d4adf247-eac6-4263-a790-5a0b40a285dd","Type":"ContainerStarted","Data":"81794cafca59baed6a133be3f9dd52768fdbd9a98ba84c53288be94c5d3e090e"}
Jul 17 18:56:26.312429 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:26.312242    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc" event={"ID":"d4adf247-eac6-4263-a790-5a0b40a285dd","Type":"ContainerStarted","Data":"edda91a04eae2bbd732f5fe96e6dfcc7dbbb4336b8e5bcc5b570eed1269a0c07"}
Jul 17 18:56:26.312429 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:26.312257    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc" event={"ID":"d4adf247-eac6-4263-a790-5a0b40a285dd","Type":"ContainerStarted","Data":"68e758a4bf1f250fc21c7aa45ff5ecc6e9c5a8c1a2ce6c9944ad6ac98a330932"}
Jul 17 18:56:26.314250 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:26.314229    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqwzr" event={"ID":"4ec676bf-440e-46c4-9ec3-491d8eb3d022","Type":"ContainerStarted","Data":"8b0f0cce531c73a53007b948ae5622ad670d4d5e2958e6e6bfb7d0a666668d10"}
Jul 17 18:56:26.332978 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:26.332938    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65cf78dbbd-qfcwc" podStartSLOduration=1.590023993 podStartE2EDuration="16.33292466s" totalImagesPullingTime="14.742900667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:26.331844454 +0000 UTC m=+98.072597264" watchObservedRunningTime="2026-07-17 18:56:26.33292466 +0000 UTC m=+98.073677496"
Jul 17 18:56:26.350799 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:26.350428    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fqwzr" podStartSLOduration=33.618596392 podStartE2EDuration="46.350412939s" totalImagesPullingTime="12.731816547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:55:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:26.349580918 +0000 UTC m=+98.090333729" watchObservedRunningTime="2026-07-17 18:56:26.350412939 +0000 UTC m=+98.091165751"
Jul 17 18:56:27.310089 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:27.310056    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:27.374583 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:27.374553    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:28.288984 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:28.288950    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:28.388760 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:28.388726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:28.488621 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:28.488577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:29.466494 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.466454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:29.695071 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.695035    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:29.750969 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.750928    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h6gxn"]
Jul 17 18:56:29.753807 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.753789    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.756046 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.756022    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sj6hh\""
Jul 17 18:56:29.756141 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.756051    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 18:56:29.756212 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.756194    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 18:56:29.756352 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.756336    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 18:56:29.756856 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.756840    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 18:56:29.828659 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.828626    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:29.871915 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.871881    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-root\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.872074 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.871922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-tls\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.872074 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.871948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-textfile\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.872074 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.871967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-sys\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.872074 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.872054    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.872246 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.872092    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5rq4\" (UniqueName: \"kubernetes.io/projected/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-kube-api-access-v5rq4\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.872246 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.872114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-metrics-client-ca\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.872246 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.872147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-wtmp\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.872246 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.872162    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.929971 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.929935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:29.973010 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.972938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973010 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.972977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5rq4\" (UniqueName: \"kubernetes.io/projected/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-kube-api-access-v5rq4\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973010 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.972998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-metrics-client-ca\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973272 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-wtmp\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973272 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973035    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973272 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-root\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973272 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-tls\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973272 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-textfile\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973272 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973143    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-sys\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973272 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-root\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973272 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973198    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-wtmp\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973272 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-sys\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973629 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:56:29.973283    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 17 18:56:29.973629 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:56:29.973356    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-tls podName:0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca nodeName:}" failed. No retries permitted until 2026-07-17 18:56:30.473333296 +0000 UTC m=+102.214086109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-tls") pod "node-exporter-h6gxn" (UID: "0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca") : secret "node-exporter-tls" not found
Jul 17 18:56:29.973629 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973531    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-textfile\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973737 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.973737 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.973645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-metrics-client-ca\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.975508 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.975485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:29.981529 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:29.981506    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5rq4\" (UniqueName: \"kubernetes.io/projected/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-kube-api-access-v5rq4\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:30.031249 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.031224    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:30.128845 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.128809    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:30.228330 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.228246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:30.328999 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.328973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:30.428550 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.428523    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:30.477788 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.477766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-tls\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:30.480298 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.480241    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca-node-exporter-tls\") pod \"node-exporter-h6gxn\" (UID: \"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca\") " pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:30.545502 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.545483    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:30.663050 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.663022    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h6gxn"
Jul 17 18:56:30.675207 ip-10-0-138-143 kubenswrapper[2558]: W0717 18:56:30.675179    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcf7adf_3308_401a_86bb_d7b4e7a2f4ca.slice/crio-49d3958ddb99d70ec7f8fc62961ebfe6aea9279e5d0fdb10b9f063f6bb5ff57b WatchSource:0}: Error finding container 49d3958ddb99d70ec7f8fc62961ebfe6aea9279e5d0fdb10b9f063f6bb5ff57b: Status 404 returned error can't find the container with id 49d3958ddb99d70ec7f8fc62961ebfe6aea9279e5d0fdb10b9f063f6bb5ff57b
Jul 17 18:56:30.699841 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.699804    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:30.809590 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:30.809509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:31.336401 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:31.336362    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6gxn" event={"ID":"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca","Type":"ContainerStarted","Data":"49d3958ddb99d70ec7f8fc62961ebfe6aea9279e5d0fdb10b9f063f6bb5ff57b"}
Jul 17 18:56:31.836278 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:31.836248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:32.247617 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:32.247578    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c99d4ff46-kwxgq"
Jul 17 18:56:32.341428 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:32.341389    2558 generic.go:356] "Generic (PLEG): container finished" podID="0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca" containerID="f2126a178401bd298b6ff2296bdba86dd0feb843f4a0466a74757ef3e8e9e2e9" exitCode=0
Jul 17 18:56:32.341566 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:32.341455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6gxn" event={"ID":"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca","Type":"ContainerDied","Data":"f2126a178401bd298b6ff2296bdba86dd0feb843f4a0466a74757ef3e8e9e2e9"}
Jul 17 18:56:32.400441 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:32.400392    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:32.507697 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:32.507675    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:32.569505 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:32.569481    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:32.684222 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:32.684195    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:32.748477 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:32.748410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:33.005480 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:33.005417    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:33.347789 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:33.347761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6gxn" event={"ID":"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca","Type":"ContainerStarted","Data":"bd5fa713db3263a05becc7741b465e01c57cbab20fb2e878de281437b36a824b"}
Jul 17 18:56:33.347917 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:33.347808    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6gxn" event={"ID":"0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca","Type":"ContainerStarted","Data":"318f755fe77cb5883f02b65296404799947200ec14a838288710642702bd49fc"}
Jul 17 18:56:33.368970 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:33.368922    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h6gxn" podStartSLOduration=3.359304419 podStartE2EDuration="4.368907539s" totalImagesPullingTime="934.157722ms" totalInitContainerRuntime="75.445398ms" isStatefulPod=true podCreationTimestamp="2026-07-17 18:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:33.368649371 +0000 UTC m=+105.109402181" watchObservedRunningTime="2026-07-17 18:56:33.368907539 +0000 UTC m=+105.109660348"
Jul 17 18:56:33.386669 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:33.386644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:33.950322 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:33.950292    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:34.020529 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:34.020500    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:34.550732 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:34.550698    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:34.618811 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:34.618781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:35.192204 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.192168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:35.512149 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.512072    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9" podUID="b248cdbd-a918-4462-a36b-8b7bdd138db1" containerName="registry" containerID="cri-o://f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9" gracePeriod=30
Jul 17 18:56:35.749723 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.749699    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:56:35.822628 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.822553    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-trusted-ca\") pod \"b248cdbd-a918-4462-a36b-8b7bdd138db1\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") "
Jul 17 18:56:35.822628 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.822623    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") pod \"b248cdbd-a918-4462-a36b-8b7bdd138db1\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") "
Jul 17 18:56:35.822764 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.822689    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-installation-pull-secrets\") pod \"b248cdbd-a918-4462-a36b-8b7bdd138db1\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") "
Jul 17 18:56:35.822764 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.822718    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-image-registry-private-configuration\") pod \"b248cdbd-a918-4462-a36b-8b7bdd138db1\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") "
Jul 17 18:56:35.822764 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.822744    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-bound-sa-token\") pod \"b248cdbd-a918-4462-a36b-8b7bdd138db1\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") "
Jul 17 18:56:35.822871 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.822771    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72fk4\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-kube-api-access-72fk4\") pod \"b248cdbd-a918-4462-a36b-8b7bdd138db1\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") "
Jul 17 18:56:35.822871 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.822806    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-certificates\") pod \"b248cdbd-a918-4462-a36b-8b7bdd138db1\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") "
Jul 17 18:56:35.822871 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.822842    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b248cdbd-a918-4462-a36b-8b7bdd138db1-ca-trust-extracted\") pod \"b248cdbd-a918-4462-a36b-8b7bdd138db1\" (UID: \"b248cdbd-a918-4462-a36b-8b7bdd138db1\") "
Jul 17 18:56:35.823014 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.822989    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b248cdbd-a918-4462-a36b-8b7bdd138db1" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:56:35.823073 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.823057    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-trusted-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 18:56:35.823649 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.823594    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b248cdbd-a918-4462-a36b-8b7bdd138db1" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:56:35.825434 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.825364    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b248cdbd-a918-4462-a36b-8b7bdd138db1" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:56:35.825693 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.825665    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b248cdbd-a918-4462-a36b-8b7bdd138db1" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:56:35.825809 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.825716    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b248cdbd-a918-4462-a36b-8b7bdd138db1" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:56:35.825809 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.825750    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b248cdbd-a918-4462-a36b-8b7bdd138db1" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:56:35.825900 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.825813    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-kube-api-access-72fk4" (OuterVolumeSpecName: "kube-api-access-72fk4") pod "b248cdbd-a918-4462-a36b-8b7bdd138db1" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1"). InnerVolumeSpecName "kube-api-access-72fk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:56:35.831392 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.831366    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b248cdbd-a918-4462-a36b-8b7bdd138db1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b248cdbd-a918-4462-a36b-8b7bdd138db1" (UID: "b248cdbd-a918-4462-a36b-8b7bdd138db1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:56:35.923764 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.923737    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 18:56:35.923764 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.923759    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-installation-pull-secrets\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 18:56:35.923875 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.923770    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b248cdbd-a918-4462-a36b-8b7bdd138db1-image-registry-private-configuration\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 18:56:35.923875 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.923780    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-bound-sa-token\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 18:56:35.923875 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.923788    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72fk4\" (UniqueName: \"kubernetes.io/projected/b248cdbd-a918-4462-a36b-8b7bdd138db1-kube-api-access-72fk4\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 18:56:35.923875 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.923795    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b248cdbd-a918-4462-a36b-8b7bdd138db1-registry-certificates\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 18:56:35.923875 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:35.923804    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b248cdbd-a918-4462-a36b-8b7bdd138db1-ca-trust-extracted\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 18:56:36.032106 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.032079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:36.147929 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.147905    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:36.244456 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.244432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:36.359735 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.359714    2558 generic.go:356] "Generic (PLEG): container finished" podID="b248cdbd-a918-4462-a36b-8b7bdd138db1" containerID="f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9" exitCode=0
Jul 17 18:56:36.359832 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.359754    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9"
Jul 17 18:56:36.359832 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.359797    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9" event={"ID":"b248cdbd-a918-4462-a36b-8b7bdd138db1","Type":"ContainerDied","Data":"f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9"}
Jul 17 18:56:36.359913 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.359839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8bfbf8569-26gc9" event={"ID":"b248cdbd-a918-4462-a36b-8b7bdd138db1","Type":"ContainerDied","Data":"4b87549995e2c55882d71d7db56e48af6add252837dccc180f55c7a94b4a24c4"}
Jul 17 18:56:36.359913 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.359862    2558 scope.go:117] "RemoveContainer" containerID="f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9"
Jul 17 18:56:36.368743 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.368726    2558 scope.go:117] "RemoveContainer" containerID="f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9"
Jul 17 18:56:36.369027 ip-10-0-138-143 kubenswrapper[2558]: E0717 18:56:36.369011    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9\": container with ID starting with f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9 not found: ID does not exist" containerID="f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9"
Jul 17 18:56:36.369078 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.369035    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9"} err="failed to get container status \"f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9\": rpc error: code = NotFound desc = could not find container \"f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9\": container with ID starting with f268cff638fb00a106f70e53d954e66c7876411800433883a22e7a6083c22ee9 not found: ID does not exist"
Jul 17 18:56:36.381755 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.381732    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8bfbf8569-26gc9"]
Jul 17 18:56:36.384730 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.384712    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8bfbf8569-26gc9"]
Jul 17 18:56:36.714319 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:36.714293    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b248cdbd-a918-4462-a36b-8b7bdd138db1" path="/var/lib/kubelet/pods/b248cdbd-a918-4462-a36b-8b7bdd138db1/volumes"
Jul 17 18:56:37.537313 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:37.537280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:37.607129 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:37.607102    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:42.335225 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:42.335192    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:42.398636 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:42.398572    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:50.912380 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:50.912319    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:51.012431 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:51.012401    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:51.068404 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:51.068375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:57.311344 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:57.311295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:57.365176 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:56:57.365141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:05.471664 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:05.471632    2558 generic.go:356] "Generic (PLEG): container finished" podID="5528a224-30ce-44ce-8f02-d15b9eadc6f0" containerID="0892ddc39a88093a9c8602213afe539dfaa2109aa104f9b83e5c3b92b558dfa0" exitCode=0
Jul 17 18:57:05.472184 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:05.471706    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pk4cb" event={"ID":"5528a224-30ce-44ce-8f02-d15b9eadc6f0","Type":"ContainerDied","Data":"0892ddc39a88093a9c8602213afe539dfaa2109aa104f9b83e5c3b92b558dfa0"}
Jul 17 18:57:05.472184 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:05.472036    2558 scope.go:117] "RemoveContainer" containerID="0892ddc39a88093a9c8602213afe539dfaa2109aa104f9b83e5c3b92b558dfa0"
Jul 17 18:57:06.478909 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:06.478880    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pk4cb" event={"ID":"5528a224-30ce-44ce-8f02-d15b9eadc6f0","Type":"ContainerStarted","Data":"5648facb1673e6538e9518676173030dd91a876126ced4f796b11bf3d7fbfff5"}
Jul 17 18:57:10.494655 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:10.494621    2558 generic.go:356] "Generic (PLEG): container finished" podID="f983cf45-a87a-48d4-a927-2e70765fa9f7" containerID="5df93e93850d0e15ca766dc139de896483cd029466058b4d5ad6ccc111a76ad2" exitCode=0
Jul 17 18:57:10.495102 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:10.494694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n" event={"ID":"f983cf45-a87a-48d4-a927-2e70765fa9f7","Type":"ContainerDied","Data":"5df93e93850d0e15ca766dc139de896483cd029466058b4d5ad6ccc111a76ad2"}
Jul 17 18:57:10.495102 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:10.494988    2558 scope.go:117] "RemoveContainer" containerID="5df93e93850d0e15ca766dc139de896483cd029466058b4d5ad6ccc111a76ad2"
Jul 17 18:57:11.499885 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:11.499854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ppp7n" event={"ID":"f983cf45-a87a-48d4-a927-2e70765fa9f7","Type":"ContainerStarted","Data":"0f9d91d88f5599a1739861fca70cbe973e4f1ca7ed53e5c7584e549d59f9326d"}
Jul 17 18:57:21.990812 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:21.990764    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:45.893666 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:45.893577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:45.994452 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:45.994428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:52.237463 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:52.237423    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:52.336571 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:52.336540    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:52.437392 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:52.437370    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:52.974772 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:52.974742    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:53.075478 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:53.075454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:57.843679 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:57.843642    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:57.941350 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:57:57.941317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:03.167637 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:58:03.167571    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:03.269509 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:58:03.269470    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:12.316555 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:58:12.316498    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:12.415491 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:58:12.415465    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:12.516654 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:58:12.516623    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:55.782853 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:58:55.782807    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:55.884712 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:58:55.884682    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:22.576222 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:22.576129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:23.558491 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:23.558456    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:26.389654 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:26.389621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:26.489915 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:26.489882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:27.701096 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:27.701068    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:27.797045 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:27.797013    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:28.527927 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:28.527897    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:28.634962 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:28.634937    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:30.332835 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:30.332796    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:30.955961 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:30.955933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:33.185716 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:33.185686    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:33.289148 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:33.289112    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:39.738861 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:39.738823    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:40.650104 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:40.650075    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:40.755493 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:40.755462    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:41.452273 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:41.452242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:48.622317 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:48.622288    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 18:59:48.627082 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:48.627062    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 18:59:48.630116 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:48.630098    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 18:59:48.633127 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:48.633107    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 18:59:48.635443 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:48.635421    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 18:59:55.792625 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:55.792574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:55.893835 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:55.893804    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:58.091507 ip-10-0-138-143 kubenswrapper[2558]: I0717 18:59:58.091464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:12.046329 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:12.046286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:13.000945 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.000906    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"]
Jul 17 19:00:13.001262 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.001244    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b248cdbd-a918-4462-a36b-8b7bdd138db1" containerName="registry"
Jul 17 19:00:13.001345 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.001264    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b248cdbd-a918-4462-a36b-8b7bdd138db1" containerName="registry"
Jul 17 19:00:13.001401 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.001351    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b248cdbd-a918-4462-a36b-8b7bdd138db1" containerName="registry"
Jul 17 19:00:13.004299 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.004277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.010427 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.010406    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 19:00:13.010537 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.010444    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 19:00:13.011039 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.010710    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 19:00:13.011241 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.011227    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 19:00:13.012493 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.012477    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p5gcz\""
Jul 17 19:00:13.020010 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.019988    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"]
Jul 17 19:00:13.088341 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.088309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.088673 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.088353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdt88\" (UniqueName: \"kubernetes.io/projected/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-kube-api-access-xdt88\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.088673 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.088376    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-manifests\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.088673 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.088425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-tmp\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.088673 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.088516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-webhook-cert\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.189036 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.189016    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-tmp\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.189148 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.189049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-webhook-cert\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.189148 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.189072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.189148 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.189113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdt88\" (UniqueName: \"kubernetes.io/projected/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-kube-api-access-xdt88\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.189148 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.189135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-manifests\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.189485 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.189463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-manifests\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.191623 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.191571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-tmp\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.191706 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.191685    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.191749 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.191714    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-webhook-cert\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.199711 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.199682    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdt88\" (UniqueName: \"kubernetes.io/projected/5e7fe309-fe30-4efe-9ce9-5eef12b06e74-kube-api-access-xdt88\") pod \"opendatahub-operator-controller-manager-b55dc8c5f-7qxrz\" (UID: \"5e7fe309-fe30-4efe-9ce9-5eef12b06e74\") " pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.314823 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.314769    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:13.454094 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.454071    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"]
Jul 17 19:00:13.456503 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:00:13.456482    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7fe309_fe30_4efe_9ce9_5eef12b06e74.slice/crio-28a399e5caefcfa44fe437e008b530e158670d484e857683cece1c1372c34b42 WatchSource:0}: Error finding container 28a399e5caefcfa44fe437e008b530e158670d484e857683cece1c1372c34b42: Status 404 returned error can't find the container with id 28a399e5caefcfa44fe437e008b530e158670d484e857683cece1c1372c34b42
Jul 17 19:00:13.458189 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:13.458174    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 19:00:14.172039 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:14.172007    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz" event={"ID":"5e7fe309-fe30-4efe-9ce9-5eef12b06e74","Type":"ContainerStarted","Data":"28a399e5caefcfa44fe437e008b530e158670d484e857683cece1c1372c34b42"}
Jul 17 19:00:14.723816 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:14.723771    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:16.547088 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:16.547040    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:16.643302 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:16.643273    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:17.186271 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:17.186237    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz" event={"ID":"5e7fe309-fe30-4efe-9ce9-5eef12b06e74","Type":"ContainerStarted","Data":"7b9e12cf4f2b538c1c8bfa36c97daff4fd8fad7c84eede6f7de7b7016d4a1d2c"}
Jul 17 19:00:18.191671 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:18.191643    2558 generic.go:356] "Generic (PLEG): container finished" podID="5e7fe309-fe30-4efe-9ce9-5eef12b06e74" containerID="7b9e12cf4f2b538c1c8bfa36c97daff4fd8fad7c84eede6f7de7b7016d4a1d2c" exitCode=0
Jul 17 19:00:18.192034 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:18.191713    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz" event={"ID":"5e7fe309-fe30-4efe-9ce9-5eef12b06e74","Type":"ContainerDied","Data":"7b9e12cf4f2b538c1c8bfa36c97daff4fd8fad7c84eede6f7de7b7016d4a1d2c"}
Jul 17 19:00:19.198178 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:19.198134    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz" event={"ID":"5e7fe309-fe30-4efe-9ce9-5eef12b06e74","Type":"ContainerStarted","Data":"9c1203040859388a195ac17d7ac56c5f0b3f85c559ad10abaeafcaeacb9787b0"}
Jul 17 19:00:19.198576 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:19.198282    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:19.221182 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:19.221134    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz" podStartSLOduration=2.71319036 podStartE2EDuration="7.221117629s" totalImagesPullingTime="3.436158597s" totalInitContainerRuntime="1.071768672s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:00:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:00:19.220895766 +0000 UTC m=+330.961648586" watchObservedRunningTime="2026-07-17 19:00:19.221117629 +0000 UTC m=+330.961870439"
Jul 17 19:00:30.204867 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:30.204838    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b55dc8c5f-7qxrz"
Jul 17 19:00:32.892395 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:32.892361    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:33.044262 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.044221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:33.629693 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.629663    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5m699"]
Jul 17 19:00:33.639851 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.639832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:33.644449 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.644429    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 17 19:00:33.647371 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.647349    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ftpsp\""
Jul 17 19:00:33.681780 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.681745    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5m699"]
Jul 17 19:00:33.731313 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.731283    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:33.739384 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.739358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fk47\" (UniqueName: \"kubernetes.io/projected/64229db7-428d-456f-82c0-38ef87c21438-kube-api-access-2fk47\") pod \"odh-model-controller-7998c67dc4-5m699\" (UID: \"64229db7-428d-456f-82c0-38ef87c21438\") " pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:33.739515 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.739414    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64229db7-428d-456f-82c0-38ef87c21438-cert\") pod \"odh-model-controller-7998c67dc4-5m699\" (UID: \"64229db7-428d-456f-82c0-38ef87c21438\") " pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:33.841001 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.840965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fk47\" (UniqueName: \"kubernetes.io/projected/64229db7-428d-456f-82c0-38ef87c21438-kube-api-access-2fk47\") pod \"odh-model-controller-7998c67dc4-5m699\" (UID: \"64229db7-428d-456f-82c0-38ef87c21438\") " pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:33.841164 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.841066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64229db7-428d-456f-82c0-38ef87c21438-cert\") pod \"odh-model-controller-7998c67dc4-5m699\" (UID: \"64229db7-428d-456f-82c0-38ef87c21438\") " pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:33.841249 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:00:33.841229    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 17 19:00:33.841317 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:00:33.841305    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64229db7-428d-456f-82c0-38ef87c21438-cert podName:64229db7-428d-456f-82c0-38ef87c21438 nodeName:}" failed. No retries permitted until 2026-07-17 19:00:34.341283779 +0000 UTC m=+346.082036567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/64229db7-428d-456f-82c0-38ef87c21438-cert") pod "odh-model-controller-7998c67dc4-5m699" (UID: "64229db7-428d-456f-82c0-38ef87c21438") : secret "odh-model-controller-webhook-cert" not found
Jul 17 19:00:33.864264 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.864220    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:33.883352 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:33.883278    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fk47\" (UniqueName: \"kubernetes.io/projected/64229db7-428d-456f-82c0-38ef87c21438-kube-api-access-2fk47\") pod \"odh-model-controller-7998c67dc4-5m699\" (UID: \"64229db7-428d-456f-82c0-38ef87c21438\") " pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:34.019787 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.019751    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:34.107577 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.107545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:34.345338 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.345314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64229db7-428d-456f-82c0-38ef87c21438-cert\") pod \"odh-model-controller-7998c67dc4-5m699\" (UID: \"64229db7-428d-456f-82c0-38ef87c21438\") " pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:34.347887 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.347849    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64229db7-428d-456f-82c0-38ef87c21438-cert\") pod \"odh-model-controller-7998c67dc4-5m699\" (UID: \"64229db7-428d-456f-82c0-38ef87c21438\") " pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:34.506615 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.506573    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rljgg"]
Jul 17 19:00:34.509123 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.509105    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:34.511706 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.511684    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 17 19:00:34.522107 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.522086    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rljgg"]
Jul 17 19:00:34.541212 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.541192    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:34.550298 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.550279    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:34.648195 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.648170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/079136bb-07a8-427c-9167-016127000064-tls-certs\") pod \"model-serving-api-54d89bd5fc-rljgg\" (UID: \"079136bb-07a8-427c-9167-016127000064\") " pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:34.648325 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.648221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8pk\" (UniqueName: \"kubernetes.io/projected/079136bb-07a8-427c-9167-016127000064-kube-api-access-5q8pk\") pod \"model-serving-api-54d89bd5fc-rljgg\" (UID: \"079136bb-07a8-427c-9167-016127000064\") " pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:34.688989 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.688954    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5m699"]
Jul 17 19:00:34.692519 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:00:34.692479    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64229db7_428d_456f_82c0_38ef87c21438.slice/crio-cfeed941258dd96d8575cbcb9d304b790b96306196bf6999649440155ec6a6ac WatchSource:0}: Error finding container cfeed941258dd96d8575cbcb9d304b790b96306196bf6999649440155ec6a6ac: Status 404 returned error can't find the container with id cfeed941258dd96d8575cbcb9d304b790b96306196bf6999649440155ec6a6ac
Jul 17 19:00:34.749413 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.749377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/079136bb-07a8-427c-9167-016127000064-tls-certs\") pod \"model-serving-api-54d89bd5fc-rljgg\" (UID: \"079136bb-07a8-427c-9167-016127000064\") " pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:34.749526 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.749437    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8pk\" (UniqueName: \"kubernetes.io/projected/079136bb-07a8-427c-9167-016127000064-kube-api-access-5q8pk\") pod \"model-serving-api-54d89bd5fc-rljgg\" (UID: \"079136bb-07a8-427c-9167-016127000064\") " pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:34.749526 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:00:34.749511    2558 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 17 19:00:34.749652 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:00:34.749565    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/079136bb-07a8-427c-9167-016127000064-tls-certs podName:079136bb-07a8-427c-9167-016127000064 nodeName:}" failed. No retries permitted until 2026-07-17 19:00:35.249550572 +0000 UTC m=+346.990303362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/079136bb-07a8-427c-9167-016127000064-tls-certs") pod "model-serving-api-54d89bd5fc-rljgg" (UID: "079136bb-07a8-427c-9167-016127000064") : secret "model-serving-api-tls" not found
Jul 17 19:00:34.760556 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.760526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8pk\" (UniqueName: \"kubernetes.io/projected/079136bb-07a8-427c-9167-016127000064-kube-api-access-5q8pk\") pod \"model-serving-api-54d89bd5fc-rljgg\" (UID: \"079136bb-07a8-427c-9167-016127000064\") " pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:34.910049 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:34.909971    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:35.252633 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:35.252510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/079136bb-07a8-427c-9167-016127000064-tls-certs\") pod \"model-serving-api-54d89bd5fc-rljgg\" (UID: \"079136bb-07a8-427c-9167-016127000064\") " pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:35.255184 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:35.255149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/079136bb-07a8-427c-9167-016127000064-tls-certs\") pod \"model-serving-api-54d89bd5fc-rljgg\" (UID: \"079136bb-07a8-427c-9167-016127000064\") " pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:35.268866 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:35.268833    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5m699" event={"ID":"64229db7-428d-456f-82c0-38ef87c21438","Type":"ContainerStarted","Data":"cfeed941258dd96d8575cbcb9d304b790b96306196bf6999649440155ec6a6ac"}
Jul 17 19:00:35.420369 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:35.420337    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:35.582015 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:35.581983    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rljgg"]
Jul 17 19:00:35.587145 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:00:35.587114    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079136bb_07a8_427c_9167_016127000064.slice/crio-308945ab879dbac27d32cf43471bca46d2f291470471070a60101dcc50146b61 WatchSource:0}: Error finding container 308945ab879dbac27d32cf43471bca46d2f291470471070a60101dcc50146b61: Status 404 returned error can't find the container with id 308945ab879dbac27d32cf43471bca46d2f291470471070a60101dcc50146b61
Jul 17 19:00:36.276239 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:36.276202    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rljgg" event={"ID":"079136bb-07a8-427c-9167-016127000064","Type":"ContainerStarted","Data":"308945ab879dbac27d32cf43471bca46d2f291470471070a60101dcc50146b61"}
Jul 17 19:00:38.293090 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:38.293029    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5m699" event={"ID":"64229db7-428d-456f-82c0-38ef87c21438","Type":"ContainerStarted","Data":"d89c9f68d8d4a2de4e5991e42d2cd68566e8a83862918f8634dbe11de6b9bc2a"}
Jul 17 19:00:38.293577 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:38.293142    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:38.294704 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:38.294679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rljgg" event={"ID":"079136bb-07a8-427c-9167-016127000064","Type":"ContainerStarted","Data":"f89bcbfc1dcd3ef3b93d7b90c436e88292b5f3ca4c0651986096b597820ffa03"}
Jul 17 19:00:38.294847 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:38.294827    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:38.311396 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:38.311323    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-5m699" podStartSLOduration=1.94383033 podStartE2EDuration="5.31130832s" totalImagesPullingTime="3.36747799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:00:38.310203512 +0000 UTC m=+350.050956322" watchObservedRunningTime="2026-07-17 19:00:38.31130832 +0000 UTC m=+350.052061130"
Jul 17 19:00:38.327233 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:38.327131    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rljgg" podStartSLOduration=1.859732086 podStartE2EDuration="4.327114517s" totalImagesPullingTime="2.467382431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:00:38.326707289 +0000 UTC m=+350.067460100" watchObservedRunningTime="2026-07-17 19:00:38.327114517 +0000 UTC m=+350.067867327"
Jul 17 19:00:38.995305 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:38.995272    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:39.039384 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.039355    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"]
Jul 17 19:00:39.042585 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.042568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.045001 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.044973    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 19:00:39.045095 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.044987    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 19:00:39.046023 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.045999    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-685nt\""
Jul 17 19:00:39.054080 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.054061    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"]
Jul 17 19:00:39.073212 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.073172    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:39.083441 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.083411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xdjx\" (UniqueName: \"kubernetes.io/projected/c074e1b9-0e93-4506-aab2-fb9129901dc2-kube-api-access-2xdjx\") pod \"kube-auth-proxy-ddf547cfd-66lqs\" (UID: \"c074e1b9-0e93-4506-aab2-fb9129901dc2\") " pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.083591 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.083450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c074e1b9-0e93-4506-aab2-fb9129901dc2-tls-certs\") pod \"kube-auth-proxy-ddf547cfd-66lqs\" (UID: \"c074e1b9-0e93-4506-aab2-fb9129901dc2\") " pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.083591 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.083511    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c074e1b9-0e93-4506-aab2-fb9129901dc2-tmp\") pod \"kube-auth-proxy-ddf547cfd-66lqs\" (UID: \"c074e1b9-0e93-4506-aab2-fb9129901dc2\") " pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.184373 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.184332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c074e1b9-0e93-4506-aab2-fb9129901dc2-tmp\") pod \"kube-auth-proxy-ddf547cfd-66lqs\" (UID: \"c074e1b9-0e93-4506-aab2-fb9129901dc2\") " pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.184568 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.184402    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xdjx\" (UniqueName: \"kubernetes.io/projected/c074e1b9-0e93-4506-aab2-fb9129901dc2-kube-api-access-2xdjx\") pod \"kube-auth-proxy-ddf547cfd-66lqs\" (UID: \"c074e1b9-0e93-4506-aab2-fb9129901dc2\") " pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.184568 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.184431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c074e1b9-0e93-4506-aab2-fb9129901dc2-tls-certs\") pod \"kube-auth-proxy-ddf547cfd-66lqs\" (UID: \"c074e1b9-0e93-4506-aab2-fb9129901dc2\") " pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.186787 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.186753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c074e1b9-0e93-4506-aab2-fb9129901dc2-tmp\") pod \"kube-auth-proxy-ddf547cfd-66lqs\" (UID: \"c074e1b9-0e93-4506-aab2-fb9129901dc2\") " pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.186953 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.186935    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c074e1b9-0e93-4506-aab2-fb9129901dc2-tls-certs\") pod \"kube-auth-proxy-ddf547cfd-66lqs\" (UID: \"c074e1b9-0e93-4506-aab2-fb9129901dc2\") " pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.192859 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.192805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xdjx\" (UniqueName: \"kubernetes.io/projected/c074e1b9-0e93-4506-aab2-fb9129901dc2-kube-api-access-2xdjx\") pod \"kube-auth-proxy-ddf547cfd-66lqs\" (UID: \"c074e1b9-0e93-4506-aab2-fb9129901dc2\") " pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.352134 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.352098    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"
Jul 17 19:00:39.487625 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:39.487574    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs"]
Jul 17 19:00:39.490763 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:00:39.490735    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc074e1b9_0e93_4506_aab2_fb9129901dc2.slice/crio-5e8e6d3529334539659488597879593b44d624b7978157ebc61c23675409ae6d WatchSource:0}: Error finding container 5e8e6d3529334539659488597879593b44d624b7978157ebc61c23675409ae6d: Status 404 returned error can't find the container with id 5e8e6d3529334539659488597879593b44d624b7978157ebc61c23675409ae6d
Jul 17 19:00:40.208013 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.207946    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"]
Jul 17 19:00:40.211054 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.211039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.213405 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.213380    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 19:00:40.213536 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.213457    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 19:00:40.213536 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.213492    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sfxgm\""
Jul 17 19:00:40.213698 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.213679    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 19:00:40.213830 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.213768    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 19:00:40.222719 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.222696    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"]
Jul 17 19:00:40.294773 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.294751    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.294856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.294794    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-token\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.294856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.294813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3f9db-3acd-462c-adda-d80f57fbdf78-local-certs\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.294856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.294841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-cacerts\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.294959 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.294878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.294959 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.294910    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5nsm\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-kube-api-access-p5nsm\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.294959 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.294926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.304232 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.304210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs" event={"ID":"c074e1b9-0e93-4506-aab2-fb9129901dc2","Type":"ContainerStarted","Data":"5e8e6d3529334539659488597879593b44d624b7978157ebc61c23675409ae6d"}
Jul 17 19:00:40.395712 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.395688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-token\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.396120 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.395721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3f9db-3acd-462c-adda-d80f57fbdf78-local-certs\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.396120 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.395751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-cacerts\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.396120 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.395783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.396120 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.395834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5nsm\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-kube-api-access-p5nsm\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.396120 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.395859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.396120 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.395969    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.396481 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.396461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.398848 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.398818    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3f9db-3acd-462c-adda-d80f57fbdf78-local-certs\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.398937 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.398885    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.398937 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.398923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-cacerts\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.399428 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.399397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.406445 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.406426    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5nsm\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-kube-api-access-p5nsm\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.414325 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.414289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-token\") pod \"istiod-openshift-gateway-7574459656-8rrft\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.520689 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.520586    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:40.585445 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.585406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:40.685361 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.685326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:40.690549 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:40.690335    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"]
Jul 17 19:00:40.692718 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:00:40.692686    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a3f9db_3acd_462c_adda_d80f57fbdf78.slice/crio-caacb8326920b623e143981e9670c8c85f98f55ce448334dbf50f415e3aa987d WatchSource:0}: Error finding container caacb8326920b623e143981e9670c8c85f98f55ce448334dbf50f415e3aa987d: Status 404 returned error can't find the container with id caacb8326920b623e143981e9670c8c85f98f55ce448334dbf50f415e3aa987d
Jul 17 19:00:41.309726 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:41.309693    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft" event={"ID":"f3a3f9db-3acd-462c-adda-d80f57fbdf78","Type":"ContainerStarted","Data":"caacb8326920b623e143981e9670c8c85f98f55ce448334dbf50f415e3aa987d"}
Jul 17 19:00:41.705224 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:41.705184    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:42.316861 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:42.316815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs" event={"ID":"c074e1b9-0e93-4506-aab2-fb9129901dc2","Type":"ContainerStarted","Data":"0e6d20310c29a46d8be65519a85e01d634cd46b37678b1417fdd31cc608f773c"}
Jul 17 19:00:42.338735 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:42.338545    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ddf547cfd-66lqs" podStartSLOduration=0.697107421 podStartE2EDuration="3.338523659s" totalImagesPullingTime="2.641416238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:00:42.337964754 +0000 UTC m=+354.078717565" watchObservedRunningTime="2026-07-17 19:00:42.338523659 +0000 UTC m=+354.079276468"
Jul 17 19:00:43.977818 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:43.977779    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:00:43.978101 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:43.977843    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:00:44.326618 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:44.326515    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft" event={"ID":"f3a3f9db-3acd-462c-adda-d80f57fbdf78","Type":"ContainerStarted","Data":"a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e"}
Jul 17 19:00:44.326783 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:44.326650    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:44.376326 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:44.376266    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft" podStartSLOduration=1.093741656 podStartE2EDuration="4.376245278s" totalImagesPullingTime="3.282503622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:00:44.374050665 +0000 UTC m=+356.114803473" watchObservedRunningTime="2026-07-17 19:00:44.376245278 +0000 UTC m=+356.116998088"
Jul 17 19:00:45.187446 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.187402    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:45.280679 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.280577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:45.334104 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.334072    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-8rrft container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 19:00:45.334277 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.334137    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft" podUID="f3a3f9db-3acd-462c-adda-d80f57fbdf78" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 19:00:45.346367 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.346340    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"]
Jul 17 19:00:45.349954 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.349936    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:00:45.352040 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.352022    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"]
Jul 17 19:00:45.353981 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.353963    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 17 19:00:45.355124 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.355090    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:00:45.355916 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.355883    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-t8k98\""
Jul 17 19:00:45.360534 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.360514    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8qkvw\""
Jul 17 19:00:45.360935 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.360915    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 17 19:00:45.366247 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.366190    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"]
Jul 17 19:00:45.369124 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.369104    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"]
Jul 17 19:00:45.375469 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.375443    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:45.441865 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.441789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mssx6\" (UniqueName: \"kubernetes.io/projected/e92b0376-0e2c-4a38-85f7-7ca534c20a70-kube-api-access-mssx6\") pod \"llmisvc-controller-manager-777c6bd7d5-dmhgm\" (UID: \"e92b0376-0e2c-4a38-85f7-7ca534c20a70\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:00:45.441865 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.441828    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59zxs\" (UniqueName: \"kubernetes.io/projected/406246ff-d678-4439-bed5-069aba7c7cb0-kube-api-access-59zxs\") pod \"kserve-controller-manager-d6f4b65b8-qllzr\" (UID: \"406246ff-d678-4439-bed5-069aba7c7cb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:00:45.442050 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.441966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/406246ff-d678-4439-bed5-069aba7c7cb0-cert\") pod \"kserve-controller-manager-d6f4b65b8-qllzr\" (UID: \"406246ff-d678-4439-bed5-069aba7c7cb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:00:45.442050 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.442036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e92b0376-0e2c-4a38-85f7-7ca534c20a70-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dmhgm\" (UID: \"e92b0376-0e2c-4a38-85f7-7ca534c20a70\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:00:45.468103 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.468070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:45.542455 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.542427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mssx6\" (UniqueName: \"kubernetes.io/projected/e92b0376-0e2c-4a38-85f7-7ca534c20a70-kube-api-access-mssx6\") pod \"llmisvc-controller-manager-777c6bd7d5-dmhgm\" (UID: \"e92b0376-0e2c-4a38-85f7-7ca534c20a70\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:00:45.542624 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.542467    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59zxs\" (UniqueName: \"kubernetes.io/projected/406246ff-d678-4439-bed5-069aba7c7cb0-kube-api-access-59zxs\") pod \"kserve-controller-manager-d6f4b65b8-qllzr\" (UID: \"406246ff-d678-4439-bed5-069aba7c7cb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:00:45.542728 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.542713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/406246ff-d678-4439-bed5-069aba7c7cb0-cert\") pod \"kserve-controller-manager-d6f4b65b8-qllzr\" (UID: \"406246ff-d678-4439-bed5-069aba7c7cb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:00:45.542763 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.542753    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e92b0376-0e2c-4a38-85f7-7ca534c20a70-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dmhgm\" (UID: \"e92b0376-0e2c-4a38-85f7-7ca534c20a70\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:00:45.545502 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.545478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/406246ff-d678-4439-bed5-069aba7c7cb0-cert\") pod \"kserve-controller-manager-d6f4b65b8-qllzr\" (UID: \"406246ff-d678-4439-bed5-069aba7c7cb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:00:45.545779 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.545595    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e92b0376-0e2c-4a38-85f7-7ca534c20a70-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dmhgm\" (UID: \"e92b0376-0e2c-4a38-85f7-7ca534c20a70\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:00:45.552016 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.551988    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mssx6\" (UniqueName: \"kubernetes.io/projected/e92b0376-0e2c-4a38-85f7-7ca534c20a70-kube-api-access-mssx6\") pod \"llmisvc-controller-manager-777c6bd7d5-dmhgm\" (UID: \"e92b0376-0e2c-4a38-85f7-7ca534c20a70\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:00:45.560342 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.560323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59zxs\" (UniqueName: \"kubernetes.io/projected/406246ff-d678-4439-bed5-069aba7c7cb0-kube-api-access-59zxs\") pod \"kserve-controller-manager-d6f4b65b8-qllzr\" (UID: \"406246ff-d678-4439-bed5-069aba7c7cb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:00:45.579552 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.579518    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:45.590944 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.590923    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"]
Jul 17 19:00:45.594380 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.594366    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.601480 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.601462    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8whvb\""
Jul 17 19:00:45.643834 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.643782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.643985 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.643854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327df949-53c2-407a-b483-7cacfc217b6c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.643985 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.643911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.643985 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.643933    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327df949-53c2-407a-b483-7cacfc217b6c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.644147 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.643997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.644147 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.644027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6prj\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-kube-api-access-m6prj\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.644147 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.644055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.644147 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.644090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.644147 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.644141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.646721 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.646696    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"]
Jul 17 19:00:45.662675 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.662652    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:00:45.676802 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.676717    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:00:45.690264 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.690222    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:45.745484 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.745484 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327df949-53c2-407a-b483-7cacfc217b6c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.745484 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.745484 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745192    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327df949-53c2-407a-b483-7cacfc217b6c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.745484 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.745484 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745267    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6prj\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-kube-api-access-m6prj\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.745484 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.745484 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.745484 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.746041 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.745546    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.746792 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.746499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.746792 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.746644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.746792 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.746762    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.747271 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.747245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327df949-53c2-407a-b483-7cacfc217b6c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.748366 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.748345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327df949-53c2-407a-b483-7cacfc217b6c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.749332 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.749314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.789570 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.789541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.802145 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.802113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6prj\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-kube-api-access-m6prj\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q277p\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.837257 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.837232    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"]
Jul 17 19:00:45.838715 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:00:45.838694    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406246ff_d678_4439_bed5_069aba7c7cb0.slice/crio-4b212e9a766d3cc9ceff5742743d0c9e2d68af334675f91e84bd5667ff7345b3 WatchSource:0}: Error finding container 4b212e9a766d3cc9ceff5742743d0c9e2d68af334675f91e84bd5667ff7345b3: Status 404 returned error can't find the container with id 4b212e9a766d3cc9ceff5742743d0c9e2d68af334675f91e84bd5667ff7345b3
Jul 17 19:00:45.903965 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.903931    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:45.937273 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:45.937249    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"]
Jul 17 19:00:45.939703 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:00:45.939668    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode92b0376_0e2c_4a38_85f7_7ca534c20a70.slice/crio-357b02cf94c0c8976484013f53b283d2df13bac9f35ee70b0dbe0f2b523f05fb WatchSource:0}: Error finding container 357b02cf94c0c8976484013f53b283d2df13bac9f35ee70b0dbe0f2b523f05fb: Status 404 returned error can't find the container with id 357b02cf94c0c8976484013f53b283d2df13bac9f35ee70b0dbe0f2b523f05fb
Jul 17 19:00:46.015434 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.015399    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:46.145251 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.145219    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"]
Jul 17 19:00:46.180915 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:00:46.180891    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327df949_53c2_407a_b483_7cacfc217b6c.slice/crio-8fef314e2a48663b5ea964a0eb70808d078c988c8f2c52de3934c75328794900 WatchSource:0}: Error finding container 8fef314e2a48663b5ea964a0eb70808d078c988c8f2c52de3934c75328794900: Status 404 returned error can't find the container with id 8fef314e2a48663b5ea964a0eb70808d078c988c8f2c52de3934c75328794900
Jul 17 19:00:46.293126 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.293046    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:46.343383 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.343350    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr" event={"ID":"406246ff-d678-4439-bed5-069aba7c7cb0","Type":"ContainerStarted","Data":"4b212e9a766d3cc9ceff5742743d0c9e2d68af334675f91e84bd5667ff7345b3"}
Jul 17 19:00:46.344464 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.344445    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p" event={"ID":"327df949-53c2-407a-b483-7cacfc217b6c","Type":"ContainerStarted","Data":"8fef314e2a48663b5ea964a0eb70808d078c988c8f2c52de3934c75328794900"}
Jul 17 19:00:46.345585 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.345561    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm" event={"ID":"e92b0376-0e2c-4a38-85f7-7ca534c20a70","Type":"ContainerStarted","Data":"357b02cf94c0c8976484013f53b283d2df13bac9f35ee70b0dbe0f2b523f05fb"}
Jul 17 19:00:46.420035 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.420006    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:46.553661 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.553572    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:00:46.768709 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.767870    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"]
Jul 17 19:00:46.768709 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.768073    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft" podUID="f3a3f9db-3acd-462c-adda-d80f57fbdf78" containerName="discovery" containerID="cri-o://a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e" gracePeriod=30
Jul 17 19:00:46.769712 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:46.769664    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:47.138565 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.138491    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:47.158291 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.157850    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5nsm\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-kube-api-access-p5nsm\") pod \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") "
Jul 17 19:00:47.158291 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.157891    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-token\") pod \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") "
Jul 17 19:00:47.158291 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.157964    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-ca-configmap\") pod \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") "
Jul 17 19:00:47.158291 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.158002    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-dns-cert\") pod \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") "
Jul 17 19:00:47.158291 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.158033    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-cacerts\") pod \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") "
Jul 17 19:00:47.158291 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.158055    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-kubeconfig\") pod \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") "
Jul 17 19:00:47.158291 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.158207    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3f9db-3acd-462c-adda-d80f57fbdf78-local-certs\") pod \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\" (UID: \"f3a3f9db-3acd-462c-adda-d80f57fbdf78\") "
Jul 17 19:00:47.158836 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.158731    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f3a3f9db-3acd-462c-adda-d80f57fbdf78" (UID: "f3a3f9db-3acd-462c-adda-d80f57fbdf78"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:00:47.161269 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.161230    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-token" (OuterVolumeSpecName: "istio-token") pod "f3a3f9db-3acd-462c-adda-d80f57fbdf78" (UID: "f3a3f9db-3acd-462c-adda-d80f57fbdf78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:00:47.161414 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.161387    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f3a3f9db-3acd-462c-adda-d80f57fbdf78" (UID: "f3a3f9db-3acd-462c-adda-d80f57fbdf78"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:00:47.161510 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.161446    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f3a3f9db-3acd-462c-adda-d80f57fbdf78" (UID: "f3a3f9db-3acd-462c-adda-d80f57fbdf78"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:00:47.161510 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.161468    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-cacerts" (OuterVolumeSpecName: "cacerts") pod "f3a3f9db-3acd-462c-adda-d80f57fbdf78" (UID: "f3a3f9db-3acd-462c-adda-d80f57fbdf78"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:00:47.161592 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.161561    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a3f9db-3acd-462c-adda-d80f57fbdf78-local-certs" (OuterVolumeSpecName: "local-certs") pod "f3a3f9db-3acd-462c-adda-d80f57fbdf78" (UID: "f3a3f9db-3acd-462c-adda-d80f57fbdf78"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:00:47.162459 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.162434    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-kube-api-access-p5nsm" (OuterVolumeSpecName: "kube-api-access-p5nsm") pod "f3a3f9db-3acd-462c-adda-d80f57fbdf78" (UID: "f3a3f9db-3acd-462c-adda-d80f57fbdf78"). InnerVolumeSpecName "kube-api-access-p5nsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:00:47.259445 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.259414    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5nsm\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-kube-api-access-p5nsm\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:47.259445 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.259443    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-token\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:47.259445 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.259453    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-ca-configmap\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:47.259729 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.259461    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-csr-dns-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:47.259729 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.259470    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-cacerts\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:47.259729 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.259478    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3a3f9db-3acd-462c-adda-d80f57fbdf78-istio-kubeconfig\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:47.259729 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.259487    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3f9db-3acd-462c-adda-d80f57fbdf78-local-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:47.353818 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.353783    2558 generic.go:356] "Generic (PLEG): container finished" podID="f3a3f9db-3acd-462c-adda-d80f57fbdf78" containerID="a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e" exitCode=0
Jul 17 19:00:47.354236 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.353849    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"
Jul 17 19:00:47.354236 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.353869    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft" event={"ID":"f3a3f9db-3acd-462c-adda-d80f57fbdf78","Type":"ContainerDied","Data":"a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e"}
Jul 17 19:00:47.354236 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.353919    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8rrft" event={"ID":"f3a3f9db-3acd-462c-adda-d80f57fbdf78","Type":"ContainerDied","Data":"caacb8326920b623e143981e9670c8c85f98f55ce448334dbf50f415e3aa987d"}
Jul 17 19:00:47.354236 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.353948    2558 scope.go:117] "RemoveContainer" containerID="a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e"
Jul 17 19:00:47.383793 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.383735    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"]
Jul 17 19:00:47.387134 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.387081    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8rrft"]
Jul 17 19:00:47.518536 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.517623    2558 scope.go:117] "RemoveContainer" containerID="a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e"
Jul 17 19:00:47.518536 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:00:47.518113    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e\": container with ID starting with a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e not found: ID does not exist" containerID="a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e"
Jul 17 19:00:47.518536 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:47.518153    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e"} err="failed to get container status \"a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e\": rpc error: code = NotFound desc = could not find container \"a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e\": container with ID starting with a0b6886c6a89de556808e9349ef32d274fc8363e3efc85e187f7dd524cdf575e not found: ID does not exist"
Jul 17 19:00:48.715619 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:48.715559    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3a3f9db-3acd-462c-adda-d80f57fbdf78" path="/var/lib/kubelet/pods/f3a3f9db-3acd-462c-adda-d80f57fbdf78/volumes"
Jul 17 19:00:49.301915 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:49.301885    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-5m699"
Jul 17 19:00:49.304315 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:49.304295    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rljgg"
Jul 17 19:00:50.049700 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.049659    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:00:50.050139 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.049736    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:00:50.050139 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.049769    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:00:50.381988 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.381958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p" event={"ID":"327df949-53c2-407a-b483-7cacfc217b6c","Type":"ContainerStarted","Data":"6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730"}
Jul 17 19:00:50.383918 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.383886    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm" event={"ID":"e92b0376-0e2c-4a38-85f7-7ca534c20a70","Type":"ContainerStarted","Data":"6c550a710b87cab5b2eaeedd05d7fbaf9ca911535480241bdc05c99076191585"}
Jul 17 19:00:50.384062 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.384049    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:00:50.385537 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.385514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr" event={"ID":"406246ff-d678-4439-bed5-069aba7c7cb0","Type":"ContainerStarted","Data":"250cb3ca72d691a3a109ac42bc4d8fb9e98f75a30a58c712d73a0cb7691df137"}
Jul 17 19:00:50.385669 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.385656    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:00:50.422684 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.422644    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p" podStartSLOduration=1.556252078 podStartE2EDuration="5.422629923s" totalImagesPullingTime="3.866377845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:00:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:00:50.420774739 +0000 UTC m=+362.161527548" watchObservedRunningTime="2026-07-17 19:00:50.422629923 +0000 UTC m=+362.163382731"
Jul 17 19:00:50.444850 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.444799    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm" podStartSLOduration=1.3305795169999999 podStartE2EDuration="5.444784079s" totalImagesPullingTime="4.114204562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:00:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:00:50.444251385 +0000 UTC m=+362.185004191" watchObservedRunningTime="2026-07-17 19:00:50.444784079 +0000 UTC m=+362.185536928"
Jul 17 19:00:50.463318 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.463269    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr" podStartSLOduration=1.252030815 podStartE2EDuration="5.463253181s" totalImagesPullingTime="4.211222366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:00:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:00:50.461938412 +0000 UTC m=+362.202691219" watchObservedRunningTime="2026-07-17 19:00:50.463253181 +0000 UTC m=+362.204005991"
Jul 17 19:00:50.904737 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:50.904699    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:51.415755 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:51.415724    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"]
Jul 17 19:00:51.905486 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:51.905453    2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-q277p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Jul 17 19:00:51.905700 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:51.905522    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p" podUID="327df949-53c2-407a-b483-7cacfc217b6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Jul 17 19:00:52.904411 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:52.904378    2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-q277p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Jul 17 19:00:52.904879 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:52.904438    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p" podUID="327df949-53c2-407a-b483-7cacfc217b6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Jul 17 19:00:53.398328 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:53.398292    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p" podUID="327df949-53c2-407a-b483-7cacfc217b6c" containerName="istio-proxy" containerID="cri-o://6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730" gracePeriod=30
Jul 17 19:00:58.647819 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.647795    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:58.759409 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759317    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-data\") pod \"327df949-53c2-407a-b483-7cacfc217b6c\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") "
Jul 17 19:00:58.759409 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759366    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327df949-53c2-407a-b483-7cacfc217b6c-istio-podinfo\") pod \"327df949-53c2-407a-b483-7cacfc217b6c\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") "
Jul 17 19:00:58.759658 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759417    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-certs\") pod \"327df949-53c2-407a-b483-7cacfc217b6c\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") "
Jul 17 19:00:58.759751 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759574    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-envoy\") pod \"327df949-53c2-407a-b483-7cacfc217b6c\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") "
Jul 17 19:00:58.759837 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759807    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6prj\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-kube-api-access-m6prj\") pod \"327df949-53c2-407a-b483-7cacfc217b6c\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") "
Jul 17 19:00:58.759837 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759574    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-data" (OuterVolumeSpecName: "istio-data") pod "327df949-53c2-407a-b483-7cacfc217b6c" (UID: "327df949-53c2-407a-b483-7cacfc217b6c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:00:58.759970 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759695    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "327df949-53c2-407a-b483-7cacfc217b6c" (UID: "327df949-53c2-407a-b483-7cacfc217b6c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:00:58.759970 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759861    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327df949-53c2-407a-b483-7cacfc217b6c-istiod-ca-cert\") pod \"327df949-53c2-407a-b483-7cacfc217b6c\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") "
Jul 17 19:00:58.759970 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759883    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-istio-token\") pod \"327df949-53c2-407a-b483-7cacfc217b6c\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") "
Jul 17 19:00:58.759970 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759902    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-socket\") pod \"327df949-53c2-407a-b483-7cacfc217b6c\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") "
Jul 17 19:00:58.759970 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.759925    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-credential-socket\") pod \"327df949-53c2-407a-b483-7cacfc217b6c\" (UID: \"327df949-53c2-407a-b483-7cacfc217b6c\") "
Jul 17 19:00:58.760429 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.760405    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "327df949-53c2-407a-b483-7cacfc217b6c" (UID: "327df949-53c2-407a-b483-7cacfc217b6c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:00:58.760525 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.760438    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/327df949-53c2-407a-b483-7cacfc217b6c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "327df949-53c2-407a-b483-7cacfc217b6c" (UID: "327df949-53c2-407a-b483-7cacfc217b6c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:00:58.760809 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.760657    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:58.760809 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.760680    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327df949-53c2-407a-b483-7cacfc217b6c-istiod-ca-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:58.760809 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.760693    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-workload-socket\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:58.760809 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.760706    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-data\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:58.761047 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.760833    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "327df949-53c2-407a-b483-7cacfc217b6c" (UID: "327df949-53c2-407a-b483-7cacfc217b6c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:00:58.762520 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.762484    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "327df949-53c2-407a-b483-7cacfc217b6c" (UID: "327df949-53c2-407a-b483-7cacfc217b6c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:00:58.762994 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.762954    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/327df949-53c2-407a-b483-7cacfc217b6c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "327df949-53c2-407a-b483-7cacfc217b6c" (UID: "327df949-53c2-407a-b483-7cacfc217b6c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:00:58.763079 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.763020    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-kube-api-access-m6prj" (OuterVolumeSpecName: "kube-api-access-m6prj") pod "327df949-53c2-407a-b483-7cacfc217b6c" (UID: "327df949-53c2-407a-b483-7cacfc217b6c"). InnerVolumeSpecName "kube-api-access-m6prj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:00:58.763079 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.763068    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-istio-token" (OuterVolumeSpecName: "istio-token") pod "327df949-53c2-407a-b483-7cacfc217b6c" (UID: "327df949-53c2-407a-b483-7cacfc217b6c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:00:58.861337 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.861310    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-istio-envoy\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:58.861337 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.861334    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6prj\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-kube-api-access-m6prj\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:58.861477 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.861345    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327df949-53c2-407a-b483-7cacfc217b6c-istio-token\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:58.861477 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.861354    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327df949-53c2-407a-b483-7cacfc217b6c-credential-socket\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:58.861477 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:58.861363    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327df949-53c2-407a-b483-7cacfc217b6c-istio-podinfo\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:00:59.427774 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:59.427734    2558 generic.go:356] "Generic (PLEG): container finished" podID="327df949-53c2-407a-b483-7cacfc217b6c" containerID="6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730" exitCode=0
Jul 17 19:00:59.427996 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:59.427791    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"
Jul 17 19:00:59.427996 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:59.427823    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p" event={"ID":"327df949-53c2-407a-b483-7cacfc217b6c","Type":"ContainerDied","Data":"6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730"}
Jul 17 19:00:59.427996 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:59.427878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p" event={"ID":"327df949-53c2-407a-b483-7cacfc217b6c","Type":"ContainerDied","Data":"8fef314e2a48663b5ea964a0eb70808d078c988c8f2c52de3934c75328794900"}
Jul 17 19:00:59.427996 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:59.427904    2558 scope.go:117] "RemoveContainer" containerID="6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730"
Jul 17 19:00:59.437377 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:59.437360    2558 scope.go:117] "RemoveContainer" containerID="6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730"
Jul 17 19:00:59.437713 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:00:59.437693    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730\": container with ID starting with 6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730 not found: ID does not exist" containerID="6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730"
Jul 17 19:00:59.437763 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:59.437724    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730"} err="failed to get container status \"6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730\": rpc error: code = NotFound desc = could not find container \"6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730\": container with ID starting with 6a610b089441e0a3a8d994df4cf27bea368dcb10cae8d1c8e74b2c49eff94730 not found: ID does not exist"
Jul 17 19:00:59.449952 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:59.449933    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"]
Jul 17 19:00:59.453398 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:00:59.453377    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q277p"]
Jul 17 19:01:00.713999 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:00.713968    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="327df949-53c2-407a-b483-7cacfc217b6c" path="/var/lib/kubelet/pods/327df949-53c2-407a-b483-7cacfc217b6c/volumes"
Jul 17 19:01:09.315035 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:09.314999    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:11.256914 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:11.256876    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:11.314645 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:11.314596    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:11.915696 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:11.915665    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:21.392062 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:21.392033    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dmhgm"
Jul 17 19:01:21.395056 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:21.395034    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qllzr"
Jul 17 19:01:34.307226 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.307162    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:34.396103 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.396071    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:34.463979 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.463945    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgsnv"]
Jul 17 19:01:34.464365 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.464348    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a3f9db-3acd-462c-adda-d80f57fbdf78" containerName="discovery"
Jul 17 19:01:34.464365 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.464366    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a3f9db-3acd-462c-adda-d80f57fbdf78" containerName="discovery"
Jul 17 19:01:34.464503 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.464381    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="327df949-53c2-407a-b483-7cacfc217b6c" containerName="istio-proxy"
Jul 17 19:01:34.464503 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.464389    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="327df949-53c2-407a-b483-7cacfc217b6c" containerName="istio-proxy"
Jul 17 19:01:34.464503 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.464485    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a3f9db-3acd-462c-adda-d80f57fbdf78" containerName="discovery"
Jul 17 19:01:34.464503 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.464500    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="327df949-53c2-407a-b483-7cacfc217b6c" containerName="istio-proxy"
Jul 17 19:01:34.476936 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.476198    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv"
Jul 17 19:01:34.478374 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.478343    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgsnv"]
Jul 17 19:01:34.479552 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.479528    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 19:01:34.479691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.479594    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5vqbn\""
Jul 17 19:01:34.480498 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.480477    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 19:01:34.518508 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.518467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:34.640009 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.639983    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbwst\" (UniqueName: \"kubernetes.io/projected/560a4604-7af4-4e33-9576-223a388455a4-kube-api-access-tbwst\") pod \"kuadrant-operator-catalog-dgsnv\" (UID: \"560a4604-7af4-4e33-9576-223a388455a4\") " pod="kuadrant-system/kuadrant-operator-catalog-dgsnv"
Jul 17 19:01:34.740617 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.740576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbwst\" (UniqueName: \"kubernetes.io/projected/560a4604-7af4-4e33-9576-223a388455a4-kube-api-access-tbwst\") pod \"kuadrant-operator-catalog-dgsnv\" (UID: \"560a4604-7af4-4e33-9576-223a388455a4\") " pod="kuadrant-system/kuadrant-operator-catalog-dgsnv"
Jul 17 19:01:34.749580 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.749555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbwst\" (UniqueName: \"kubernetes.io/projected/560a4604-7af4-4e33-9576-223a388455a4-kube-api-access-tbwst\") pod \"kuadrant-operator-catalog-dgsnv\" (UID: \"560a4604-7af4-4e33-9576-223a388455a4\") " pod="kuadrant-system/kuadrant-operator-catalog-dgsnv"
Jul 17 19:01:34.786121 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.786100    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgsnv"]
Jul 17 19:01:34.786309 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.786294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv"
Jul 17 19:01:34.914320 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.914296    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgsnv"]
Jul 17 19:01:34.916664 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:01:34.916637    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560a4604_7af4_4e33_9576_223a388455a4.slice/crio-9df81f00819148d3a0ba797a159fa90328f214e65cd1dda3105e340690de4c8d WatchSource:0}: Error finding container 9df81f00819148d3a0ba797a159fa90328f214e65cd1dda3105e340690de4c8d: Status 404 returned error can't find the container with id 9df81f00819148d3a0ba797a159fa90328f214e65cd1dda3105e340690de4c8d
Jul 17 19:01:34.997443 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:34.997409    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5njkl"]
Jul 17 19:01:35.000232 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:35.000212    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5njkl"
Jul 17 19:01:35.008984 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:35.008963    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5njkl"]
Jul 17 19:01:35.144315 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:35.144289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfrm6\" (UniqueName: \"kubernetes.io/projected/163c54e3-0a6f-49f8-80a1-7af67a477754-kube-api-access-xfrm6\") pod \"kuadrant-operator-catalog-5njkl\" (UID: \"163c54e3-0a6f-49f8-80a1-7af67a477754\") " pod="kuadrant-system/kuadrant-operator-catalog-5njkl"
Jul 17 19:01:35.245695 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:35.245627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfrm6\" (UniqueName: \"kubernetes.io/projected/163c54e3-0a6f-49f8-80a1-7af67a477754-kube-api-access-xfrm6\") pod \"kuadrant-operator-catalog-5njkl\" (UID: \"163c54e3-0a6f-49f8-80a1-7af67a477754\") " pod="kuadrant-system/kuadrant-operator-catalog-5njkl"
Jul 17 19:01:35.253839 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:35.253816    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfrm6\" (UniqueName: \"kubernetes.io/projected/163c54e3-0a6f-49f8-80a1-7af67a477754-kube-api-access-xfrm6\") pod \"kuadrant-operator-catalog-5njkl\" (UID: \"163c54e3-0a6f-49f8-80a1-7af67a477754\") " pod="kuadrant-system/kuadrant-operator-catalog-5njkl"
Jul 17 19:01:35.309722 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:35.309699    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5njkl"
Jul 17 19:01:35.437849 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:35.437827    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5njkl"]
Jul 17 19:01:35.440332 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:01:35.440306    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163c54e3_0a6f_49f8_80a1_7af67a477754.slice/crio-3772ab3ebc70e48b1af3a35bd5819c3ea1be68012290322f735b8497cee1f489 WatchSource:0}: Error finding container 3772ab3ebc70e48b1af3a35bd5819c3ea1be68012290322f735b8497cee1f489: Status 404 returned error can't find the container with id 3772ab3ebc70e48b1af3a35bd5819c3ea1be68012290322f735b8497cee1f489
Jul 17 19:01:35.584347 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:35.584323    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5njkl" event={"ID":"163c54e3-0a6f-49f8-80a1-7af67a477754","Type":"ContainerStarted","Data":"3772ab3ebc70e48b1af3a35bd5819c3ea1be68012290322f735b8497cee1f489"}
Jul 17 19:01:35.585378 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:35.585358    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv" event={"ID":"560a4604-7af4-4e33-9576-223a388455a4","Type":"ContainerStarted","Data":"9df81f00819148d3a0ba797a159fa90328f214e65cd1dda3105e340690de4c8d"}
Jul 17 19:01:37.596429 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:37.596393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5njkl" event={"ID":"163c54e3-0a6f-49f8-80a1-7af67a477754","Type":"ContainerStarted","Data":"1efe1d82b24bb8c5117ab635f03d742bcbc4a7f230719a595467879073da1c5b"}
Jul 17 19:01:37.598052 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:37.598029    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv" event={"ID":"560a4604-7af4-4e33-9576-223a388455a4","Type":"ContainerStarted","Data":"1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8"}
Jul 17 19:01:37.598183 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:37.598124    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv" podUID="560a4604-7af4-4e33-9576-223a388455a4" containerName="registry-server" containerID="cri-o://1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8" gracePeriod=2
Jul 17 19:01:37.638087 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:37.638048    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5njkl" podStartSLOduration=2.101198299 podStartE2EDuration="3.638035112s" totalImagesPullingTime="1.536836813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:01:37.619515943 +0000 UTC m=+409.360268767" watchObservedRunningTime="2026-07-17 19:01:37.638035112 +0000 UTC m=+409.378787921"
Jul 17 19:01:37.638645 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:37.638621    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv" podStartSLOduration=1.578837329 podStartE2EDuration="3.638593144s" totalImagesPullingTime="2.059755815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:01:37.636368446 +0000 UTC m=+409.377121254" watchObservedRunningTime="2026-07-17 19:01:37.638593144 +0000 UTC m=+409.379345953"
Jul 17 19:01:37.846507 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:37.846456    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv"
Jul 17 19:01:37.866657 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:37.866636    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbwst\" (UniqueName: \"kubernetes.io/projected/560a4604-7af4-4e33-9576-223a388455a4-kube-api-access-tbwst\") pod \"560a4604-7af4-4e33-9576-223a388455a4\" (UID: \"560a4604-7af4-4e33-9576-223a388455a4\") "
Jul 17 19:01:37.869124 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:37.869093    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/560a4604-7af4-4e33-9576-223a388455a4-kube-api-access-tbwst" (OuterVolumeSpecName: "kube-api-access-tbwst") pod "560a4604-7af4-4e33-9576-223a388455a4" (UID: "560a4604-7af4-4e33-9576-223a388455a4"). InnerVolumeSpecName "kube-api-access-tbwst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:01:37.967253 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:37.967229    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbwst\" (UniqueName: \"kubernetes.io/projected/560a4604-7af4-4e33-9576-223a388455a4-kube-api-access-tbwst\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:01:38.610767 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.610739    2558 generic.go:356] "Generic (PLEG): container finished" podID="560a4604-7af4-4e33-9576-223a388455a4" containerID="1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8" exitCode=0
Jul 17 19:01:38.611219 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.610808    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv" event={"ID":"560a4604-7af4-4e33-9576-223a388455a4","Type":"ContainerDied","Data":"1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8"}
Jul 17 19:01:38.611219 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.610842    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv"
Jul 17 19:01:38.611219 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.610879    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dgsnv" event={"ID":"560a4604-7af4-4e33-9576-223a388455a4","Type":"ContainerDied","Data":"9df81f00819148d3a0ba797a159fa90328f214e65cd1dda3105e340690de4c8d"}
Jul 17 19:01:38.611219 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.610900    2558 scope.go:117] "RemoveContainer" containerID="1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8"
Jul 17 19:01:38.620507 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.620490    2558 scope.go:117] "RemoveContainer" containerID="1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8"
Jul 17 19:01:38.620774 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:01:38.620753    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8\": container with ID starting with 1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8 not found: ID does not exist" containerID="1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8"
Jul 17 19:01:38.620846 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.620785    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8"} err="failed to get container status \"1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8\": rpc error: code = NotFound desc = could not find container \"1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8\": container with ID starting with 1c4165444947c45e53ba68632491f6dbbc0cef72a3fd6d5d4a1a7ff74008bac8 not found: ID does not exist"
Jul 17 19:01:38.631527 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.631502    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgsnv"]
Jul 17 19:01:38.637874 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.637850    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgsnv"]
Jul 17 19:01:38.714889 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:38.714856    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="560a4604-7af4-4e33-9576-223a388455a4" path="/var/lib/kubelet/pods/560a4604-7af4-4e33-9576-223a388455a4/volumes"
Jul 17 19:01:45.310825 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:45.310788    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5njkl"
Jul 17 19:01:45.311305 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:45.310849    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5njkl"
Jul 17 19:01:45.336224 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:45.336198    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5njkl"
Jul 17 19:01:45.666977 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:45.666950    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5njkl"
Jul 17 19:01:59.159319 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:59.159286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:59.362015 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:59.361987    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:59.418741 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:59.418659    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:59.900485 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:59.900456    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:01:59.967461 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:01:59.967431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:03.056170 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:03.056115    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:05.979831 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:05.979800    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"]
Jul 17 19:02:05.980289 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:05.980111    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="560a4604-7af4-4e33-9576-223a388455a4" containerName="registry-server"
Jul 17 19:02:05.980289 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:05.980121    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="560a4604-7af4-4e33-9576-223a388455a4" containerName="registry-server"
Jul 17 19:02:05.980289 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:05.980185    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="560a4604-7af4-4e33-9576-223a388455a4" containerName="registry-server"
Jul 17 19:02:05.987992 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:05.987960    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:05.991147 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:05.991127    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2tzsm\""
Jul 17 19:02:06.001339 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:06.001320    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"]
Jul 17 19:02:06.070296 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:06.070274    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nk5j\" (UniqueName: \"kubernetes.io/projected/9cd4fd2d-069c-4679-a805-c8d02162222e-kube-api-access-9nk5j\") pod \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" (UID: \"9cd4fd2d-069c-4679-a805-c8d02162222e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:06.171474 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:06.171449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nk5j\" (UniqueName: \"kubernetes.io/projected/9cd4fd2d-069c-4679-a805-c8d02162222e-kube-api-access-9nk5j\") pod \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" (UID: \"9cd4fd2d-069c-4679-a805-c8d02162222e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:06.180904 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:06.180879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nk5j\" (UniqueName: \"kubernetes.io/projected/9cd4fd2d-069c-4679-a805-c8d02162222e-kube-api-access-9nk5j\") pod \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" (UID: \"9cd4fd2d-069c-4679-a805-c8d02162222e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:06.298373 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:06.298313    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:06.432664 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:06.432636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"]
Jul 17 19:02:06.435459 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:02:06.435435    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd4fd2d_069c_4679_a805_c8d02162222e.slice/crio-68db6d09b1f4d396d4cd297f16239ca8e5aaf795027b82820261df813fc98a04 WatchSource:0}: Error finding container 68db6d09b1f4d396d4cd297f16239ca8e5aaf795027b82820261df813fc98a04: Status 404 returned error can't find the container with id 68db6d09b1f4d396d4cd297f16239ca8e5aaf795027b82820261df813fc98a04
Jul 17 19:02:06.735981 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:06.735953    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c" event={"ID":"9cd4fd2d-069c-4679-a805-c8d02162222e","Type":"ContainerStarted","Data":"68db6d09b1f4d396d4cd297f16239ca8e5aaf795027b82820261df813fc98a04"}
Jul 17 19:02:07.480262 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:07.480233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:09.532095 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.532064    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"]
Jul 17 19:02:09.535627 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.535591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"
Jul 17 19:02:09.538849 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.538827    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 19:02:09.538943 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.538931    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9qnhb\""
Jul 17 19:02:09.549835 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.549815    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"]
Jul 17 19:02:09.600286 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.600259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh72z\" (UniqueName: \"kubernetes.io/projected/fb17a0b5-5253-43c2-9653-33edd2fbd55e-kube-api-access-vh72z\") pod \"dns-operator-controller-manager-864dd78c4c-fm7tx\" (UID: \"fb17a0b5-5253-43c2-9653-33edd2fbd55e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"
Jul 17 19:02:09.700596 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.700568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh72z\" (UniqueName: \"kubernetes.io/projected/fb17a0b5-5253-43c2-9653-33edd2fbd55e-kube-api-access-vh72z\") pod \"dns-operator-controller-manager-864dd78c4c-fm7tx\" (UID: \"fb17a0b5-5253-43c2-9653-33edd2fbd55e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"
Jul 17 19:02:09.710695 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.710670    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh72z\" (UniqueName: \"kubernetes.io/projected/fb17a0b5-5253-43c2-9653-33edd2fbd55e-kube-api-access-vh72z\") pod \"dns-operator-controller-manager-864dd78c4c-fm7tx\" (UID: \"fb17a0b5-5253-43c2-9653-33edd2fbd55e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"
Jul 17 19:02:09.752529 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.752500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c" event={"ID":"9cd4fd2d-069c-4679-a805-c8d02162222e","Type":"ContainerStarted","Data":"21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56"}
Jul 17 19:02:09.752671 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.752646    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:09.845696 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.845670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"
Jul 17 19:02:09.890972 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.890945    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:09.980506 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.980446    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c" podStartSLOduration=2.6087909639999998 podStartE2EDuration="4.980430877s" totalImagesPullingTime="2.371639913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:02:09.779587472 +0000 UTC m=+441.520340281" watchObservedRunningTime="2026-07-17 19:02:09.980430877 +0000 UTC m=+441.721183744"
Jul 17 19:02:09.981005 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:09.980989    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"]
Jul 17 19:02:09.982976 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:02:09.982954    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb17a0b5_5253_43c2_9653_33edd2fbd55e.slice/crio-0b7c1800c80b7876b0ecf4a689f00cb89cf32c1cc291cd4d1d40cec3dc3c6980 WatchSource:0}: Error finding container 0b7c1800c80b7876b0ecf4a689f00cb89cf32c1cc291cd4d1d40cec3dc3c6980: Status 404 returned error can't find the container with id 0b7c1800c80b7876b0ecf4a689f00cb89cf32c1cc291cd4d1d40cec3dc3c6980
Jul 17 19:02:10.105771 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:10.105701    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:10.210404 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:10.210348    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:10.341524 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:10.341488    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:10.757476 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:10.757446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx" event={"ID":"fb17a0b5-5253-43c2-9653-33edd2fbd55e","Type":"ContainerStarted","Data":"0b7c1800c80b7876b0ecf4a689f00cb89cf32c1cc291cd4d1d40cec3dc3c6980"}
Jul 17 19:02:11.884319 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:11.884286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:13.355692 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:13.355661    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:13.776028 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:13.775933    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx" event={"ID":"fb17a0b5-5253-43c2-9653-33edd2fbd55e","Type":"ContainerStarted","Data":"f63190fe6b54a3fbe0f0db2f440f0239457512ec4e21895678c422b58ed1f3cd"}
Jul 17 19:02:13.776028 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:13.776001    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"
Jul 17 19:02:13.795405 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:13.795361    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx" podStartSLOduration=2.077831313 podStartE2EDuration="4.795348311s" totalImagesPullingTime="2.717516998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:02:13.794364153 +0000 UTC m=+445.535116963" watchObservedRunningTime="2026-07-17 19:02:13.795348311 +0000 UTC m=+445.536101119"
Jul 17 19:02:14.470632 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.470572    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"]
Jul 17 19:02:14.473929 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.473909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:14.476354 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.476333    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b2sv6\""
Jul 17 19:02:14.498731 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.498708    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"]
Jul 17 19:02:14.539242 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.539214    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d171048-d319-4d85-b89f-57b92da7671a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" (UID: \"4d171048-d319-4d85-b89f-57b92da7671a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:14.539335 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.539287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f255\" (UniqueName: \"kubernetes.io/projected/4d171048-d319-4d85-b89f-57b92da7671a-kube-api-access-6f255\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" (UID: \"4d171048-d319-4d85-b89f-57b92da7671a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:14.640178 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.640149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d171048-d319-4d85-b89f-57b92da7671a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" (UID: \"4d171048-d319-4d85-b89f-57b92da7671a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:14.640299 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.640219    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f255\" (UniqueName: \"kubernetes.io/projected/4d171048-d319-4d85-b89f-57b92da7671a-kube-api-access-6f255\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" (UID: \"4d171048-d319-4d85-b89f-57b92da7671a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:14.640497 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.640474    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d171048-d319-4d85-b89f-57b92da7671a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" (UID: \"4d171048-d319-4d85-b89f-57b92da7671a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:14.651511 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.651495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f255\" (UniqueName: \"kubernetes.io/projected/4d171048-d319-4d85-b89f-57b92da7671a-kube-api-access-6f255\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" (UID: \"4d171048-d319-4d85-b89f-57b92da7671a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:14.784973 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.784904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:14.850201 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.850099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:14.918369 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:14.918322    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"]
Jul 17 19:02:14.921222 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:02:14.921195    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d171048_d319_4d85_b89f_57b92da7671a.slice/crio-49922d74ef3d85040ded0302ca8c96177c99053514dd6754bc70489a683ae47f WatchSource:0}: Error finding container 49922d74ef3d85040ded0302ca8c96177c99053514dd6754bc70489a683ae47f: Status 404 returned error can't find the container with id 49922d74ef3d85040ded0302ca8c96177c99053514dd6754bc70489a683ae47f
Jul 17 19:02:15.121106 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:15.121079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:15.494411 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:15.494344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:15.788051 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:15.787980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r" event={"ID":"4d171048-d319-4d85-b89f-57b92da7671a","Type":"ContainerStarted","Data":"49922d74ef3d85040ded0302ca8c96177c99053514dd6754bc70489a683ae47f"}
Jul 17 19:02:17.720508 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:17.720467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:17.832202 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:17.832166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:18.204365 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.204320    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:18.319495 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.319467    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"]
Jul 17 19:02:18.322828 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.322813    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"
Jul 17 19:02:18.325519 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.325497    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-v92h8\""
Jul 17 19:02:18.337760 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.337736    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"]
Jul 17 19:02:18.369349 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.369320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbzq4\" (UniqueName: \"kubernetes.io/projected/a3194c85-1f44-42bc-94ab-9dd85c6addbe-kube-api-access-pbzq4\") pod \"authorino-operator-75cc8d5cb7-xks7x\" (UID: \"a3194c85-1f44-42bc-94ab-9dd85c6addbe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"
Jul 17 19:02:18.470642 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.470552    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbzq4\" (UniqueName: \"kubernetes.io/projected/a3194c85-1f44-42bc-94ab-9dd85c6addbe-kube-api-access-pbzq4\") pod \"authorino-operator-75cc8d5cb7-xks7x\" (UID: \"a3194c85-1f44-42bc-94ab-9dd85c6addbe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"
Jul 17 19:02:18.485655 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.485633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbzq4\" (UniqueName: \"kubernetes.io/projected/a3194c85-1f44-42bc-94ab-9dd85c6addbe-kube-api-access-pbzq4\") pod \"authorino-operator-75cc8d5cb7-xks7x\" (UID: \"a3194c85-1f44-42bc-94ab-9dd85c6addbe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"
Jul 17 19:02:18.634935 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.634909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"
Jul 17 19:02:18.789994 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.789950    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"]
Jul 17 19:02:18.794729 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:02:18.794697    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3194c85_1f44_42bc_94ab_9dd85c6addbe.slice/crio-5bbc9d3bb50e721c352ca4dfb13cb2ed8311a5221b3ea2656bcc3c8f77cd6d83 WatchSource:0}: Error finding container 5bbc9d3bb50e721c352ca4dfb13cb2ed8311a5221b3ea2656bcc3c8f77cd6d83: Status 404 returned error can't find the container with id 5bbc9d3bb50e721c352ca4dfb13cb2ed8311a5221b3ea2656bcc3c8f77cd6d83
Jul 17 19:02:18.805121 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:18.805092    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x" event={"ID":"a3194c85-1f44-42bc-94ab-9dd85c6addbe","Type":"ContainerStarted","Data":"5bbc9d3bb50e721c352ca4dfb13cb2ed8311a5221b3ea2656bcc3c8f77cd6d83"}
Jul 17 19:02:19.935920 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:19.935836    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:20.033950 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:20.033847    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:20.760037 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:20.760005    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:21.899754 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:21.899728    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:22.015098 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:22.015067    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:22.828592 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:22.828556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x" event={"ID":"a3194c85-1f44-42bc-94ab-9dd85c6addbe","Type":"ContainerStarted","Data":"9665e4ff25b40a86f2b6997ceca499534e4b3cef4ae5ac75bc4b5a06ee0509ef"}
Jul 17 19:02:22.828796 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:22.828737    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"
Jul 17 19:02:22.830340 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:22.830316    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r" event={"ID":"4d171048-d319-4d85-b89f-57b92da7671a","Type":"ContainerStarted","Data":"bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193"}
Jul 17 19:02:22.830447 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:22.830365    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:22.847465 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:22.847394    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x" podStartSLOduration=1.745839804 podStartE2EDuration="4.847377983s" totalImagesPullingTime="3.101538179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:02:22.845543348 +0000 UTC m=+454.586296169" watchObservedRunningTime="2026-07-17 19:02:22.847377983 +0000 UTC m=+454.588130793"
Jul 17 19:02:22.867563 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:22.867526    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r" podStartSLOduration=1.928913179 podStartE2EDuration="8.867513808s" totalImagesPullingTime="6.938600629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:02:22.866300801 +0000 UTC m=+454.607053610" watchObservedRunningTime="2026-07-17 19:02:22.867513808 +0000 UTC m=+454.608266616"
Jul 17 19:02:24.518239 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:24.518202    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:24.784836 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:24.784764    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm7tx"
Jul 17 19:02:24.928288 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:24.928256    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:27.424554 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:27.424523    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:27.525149 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:27.525123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:33.836480 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:33.836450    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xks7x"
Jul 17 19:02:33.836970 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:33.836514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.584390 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.584359    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"]
Jul 17 19:02:35.584819 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.584518    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r" podUID="4d171048-d319-4d85-b89f-57b92da7671a" containerName="manager" containerID="cri-o://bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193" gracePeriod=2
Jul 17 19:02:35.589951 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.589916    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"]
Jul 17 19:02:35.603621 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.600893    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"]
Jul 17 19:02:35.603621 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.601184    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" containerName="manager" containerID="cri-o://21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56" gracePeriod=2
Jul 17 19:02:35.610228 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.608872    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="4d171048-d319-4d85-b89f-57b92da7671a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.610377 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.610218    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"]
Jul 17 19:02:35.619126 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.619102    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"]
Jul 17 19:02:35.619583 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.619567    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d171048-d319-4d85-b89f-57b92da7671a" containerName="manager"
Jul 17 19:02:35.619701 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.619586    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d171048-d319-4d85-b89f-57b92da7671a" containerName="manager"
Jul 17 19:02:35.619701 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.619616    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" containerName="manager"
Jul 17 19:02:35.619701 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.619625    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" containerName="manager"
Jul 17 19:02:35.619860 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.619717    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d171048-d319-4d85-b89f-57b92da7671a" containerName="manager"
Jul 17 19:02:35.619860 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.619728    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" containerName="manager"
Jul 17 19:02:35.622807 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.622790    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:35.628569 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.628544    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"]
Jul 17 19:02:35.632279 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.632258    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"
Jul 17 19:02:35.635787 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.635768    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"]
Jul 17 19:02:35.645577 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.645554    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"]
Jul 17 19:02:35.659939 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.659911    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="4d171048-d319-4d85-b89f-57b92da7671a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.661814 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.661789    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:35.663590 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.663550    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:35.681657 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.681629    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="4d171048-d319-4d85-b89f-57b92da7671a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.710624 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.710586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghdk9\" (UniqueName: \"kubernetes.io/projected/3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253-kube-api-access-ghdk9\") pod \"limitador-operator-controller-manager-859d7b78bd-lgvnl\" (UID: \"3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"
Jul 17 19:02:35.710722 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.710673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8303fb93-bced-450b-a3db-693bd576c161-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjb8h\" (UID: \"8303fb93-bced-450b-a3db-693bd576c161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:35.710784 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.710742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjr7l\" (UniqueName: \"kubernetes.io/projected/8303fb93-bced-450b-a3db-693bd576c161-kube-api-access-mjr7l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjb8h\" (UID: \"8303fb93-bced-450b-a3db-693bd576c161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:35.812091 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.812060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghdk9\" (UniqueName: \"kubernetes.io/projected/3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253-kube-api-access-ghdk9\") pod \"limitador-operator-controller-manager-859d7b78bd-lgvnl\" (UID: \"3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"
Jul 17 19:02:35.812230 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.812120    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8303fb93-bced-450b-a3db-693bd576c161-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjb8h\" (UID: \"8303fb93-bced-450b-a3db-693bd576c161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:35.812230 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.812171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjr7l\" (UniqueName: \"kubernetes.io/projected/8303fb93-bced-450b-a3db-693bd576c161-kube-api-access-mjr7l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjb8h\" (UID: \"8303fb93-bced-450b-a3db-693bd576c161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:35.812549 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.812525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8303fb93-bced-450b-a3db-693bd576c161-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjb8h\" (UID: \"8303fb93-bced-450b-a3db-693bd576c161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:35.824869 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.824814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghdk9\" (UniqueName: \"kubernetes.io/projected/3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253-kube-api-access-ghdk9\") pod \"limitador-operator-controller-manager-859d7b78bd-lgvnl\" (UID: \"3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"
Jul 17 19:02:35.835254 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.835163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjr7l\" (UniqueName: \"kubernetes.io/projected/8303fb93-bced-450b-a3db-693bd576c161-kube-api-access-mjr7l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjb8h\" (UID: \"8303fb93-bced-450b-a3db-693bd576c161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:35.867825 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.867802    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.869805 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.869790    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:35.870032 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.870012    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:35.871813 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.871794    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="4d171048-d319-4d85-b89f-57b92da7671a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.873669 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.873644    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="4d171048-d319-4d85-b89f-57b92da7671a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.875892 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.875876    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:35.891984 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.891962    2558 generic.go:356] "Generic (PLEG): container finished" podID="9cd4fd2d-069c-4679-a805-c8d02162222e" containerID="21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56" exitCode=0
Jul 17 19:02:35.892089 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.892002    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:35.892089 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.892065    2558 scope.go:117] "RemoveContainer" containerID="21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56"
Jul 17 19:02:35.893460 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.893441    2558 generic.go:356] "Generic (PLEG): container finished" podID="4d171048-d319-4d85-b89f-57b92da7671a" containerID="bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193" exitCode=0
Jul 17 19:02:35.893682 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.893667    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.894260 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.894235    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:35.896167 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.896145    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="4d171048-d319-4d85-b89f-57b92da7671a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.897944 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.897922    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:35.899770 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.899747    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="4d171048-d319-4d85-b89f-57b92da7671a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:35.901191 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.901176    2558 scope.go:117] "RemoveContainer" containerID="21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56"
Jul 17 19:02:35.901427 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.901411    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56\": container with ID starting with 21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56 not found: ID does not exist" containerID="21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56"
Jul 17 19:02:35.901470 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.901433    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56"} err="failed to get container status \"21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56\": rpc error: code = NotFound desc = could not find container \"21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56\": container with ID starting with 21636d65e83076f8b1b925e2dc64d407b3171654f5812ce1b7c5c2d42c4b1b56 not found: ID does not exist"
Jul 17 19:02:35.901470 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.901448    2558 scope.go:117] "RemoveContainer" containerID="bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193"
Jul 17 19:02:35.909012 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.908998    2558 scope.go:117] "RemoveContainer" containerID="bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193"
Jul 17 19:02:35.909246 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:35.909227    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193\": container with ID starting with bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193 not found: ID does not exist" containerID="bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193"
Jul 17 19:02:35.909306 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:35.909250    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193"} err="failed to get container status \"bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193\": rpc error: code = NotFound desc = could not find container \"bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193\": container with ID starting with bb68897721b2057307c0188b313aa006767b7d2b53ca441df9556211233fa193 not found: ID does not exist"
Jul 17 19:02:36.013093 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.013066    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:36.013241 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.013192    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d171048-d319-4d85-b89f-57b92da7671a-extensions-socket-volume\") pod \"4d171048-d319-4d85-b89f-57b92da7671a\" (UID: \"4d171048-d319-4d85-b89f-57b92da7671a\") "
Jul 17 19:02:36.013282 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.013245    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f255\" (UniqueName: \"kubernetes.io/projected/4d171048-d319-4d85-b89f-57b92da7671a-kube-api-access-6f255\") pod \"4d171048-d319-4d85-b89f-57b92da7671a\" (UID: \"4d171048-d319-4d85-b89f-57b92da7671a\") "
Jul 17 19:02:36.013351 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.013334    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nk5j\" (UniqueName: \"kubernetes.io/projected/9cd4fd2d-069c-4679-a805-c8d02162222e-kube-api-access-9nk5j\") pod \"9cd4fd2d-069c-4679-a805-c8d02162222e\" (UID: \"9cd4fd2d-069c-4679-a805-c8d02162222e\") "
Jul 17 19:02:36.013701 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.013677    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d171048-d319-4d85-b89f-57b92da7671a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d171048-d319-4d85-b89f-57b92da7671a" (UID: "4d171048-d319-4d85-b89f-57b92da7671a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:02:36.015408 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.015384    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d171048-d319-4d85-b89f-57b92da7671a-kube-api-access-6f255" (OuterVolumeSpecName: "kube-api-access-6f255") pod "4d171048-d319-4d85-b89f-57b92da7671a" (UID: "4d171048-d319-4d85-b89f-57b92da7671a"). InnerVolumeSpecName "kube-api-access-6f255". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:02:36.015538 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.015517    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd4fd2d-069c-4679-a805-c8d02162222e-kube-api-access-9nk5j" (OuterVolumeSpecName: "kube-api-access-9nk5j") pod "9cd4fd2d-069c-4679-a805-c8d02162222e" (UID: "9cd4fd2d-069c-4679-a805-c8d02162222e"). InnerVolumeSpecName "kube-api-access-9nk5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:02:36.022519 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.022498    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"
Jul 17 19:02:36.114929 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.114901    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f255\" (UniqueName: \"kubernetes.io/projected/4d171048-d319-4d85-b89f-57b92da7671a-kube-api-access-6f255\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:02:36.114929 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.114927    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nk5j\" (UniqueName: \"kubernetes.io/projected/9cd4fd2d-069c-4679-a805-c8d02162222e-kube-api-access-9nk5j\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:02:36.115706 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.114941    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d171048-d319-4d85-b89f-57b92da7671a-extensions-socket-volume\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:02:36.161174 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.161147    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"]
Jul 17 19:02:36.164133 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:02:36.164101    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8303fb93_bced_450b_a3db_693bd576c161.slice/crio-f4fefae96304f606a4db8df8bf973db2a6b1aee86f6eb7954ed7cccbbfe8e71c WatchSource:0}: Error finding container f4fefae96304f606a4db8df8bf973db2a6b1aee86f6eb7954ed7cccbbfe8e71c: Status 404 returned error can't find the container with id f4fefae96304f606a4db8df8bf973db2a6b1aee86f6eb7954ed7cccbbfe8e71c
Jul 17 19:02:36.185721 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.185700    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"]
Jul 17 19:02:36.187388 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:02:36.187356    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fcda26f_7b3b_4fa5_86d6_ee3f7cd15253.slice/crio-23cc61d020e27a3a531f35fd38b8ff289cfdec89db24cad1cade085c724c362f WatchSource:0}: Error finding container 23cc61d020e27a3a531f35fd38b8ff289cfdec89db24cad1cade085c724c362f: Status 404 returned error can't find the container with id 23cc61d020e27a3a531f35fd38b8ff289cfdec89db24cad1cade085c724c362f
Jul 17 19:02:36.205983 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:36.205958    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:36.207690 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:36.207668    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="4d171048-d319-4d85-b89f-57b92da7671a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:36.209371 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:36.209343    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qbc2r\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="4d171048-d319-4d85-b89f-57b92da7671a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qbc2r"
Jul 17 19:02:36.211037 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:36.211015    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9vw6c\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9vw6c"
Jul 17 19:02:36.714683 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.714655    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d171048-d319-4d85-b89f-57b92da7671a" path="/var/lib/kubelet/pods/4d171048-d319-4d85-b89f-57b92da7671a/volumes"
Jul 17 19:02:36.715008 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.714980    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd4fd2d-069c-4679-a805-c8d02162222e" path="/var/lib/kubelet/pods/9cd4fd2d-069c-4679-a805-c8d02162222e/volumes"
Jul 17 19:02:36.875174 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.875084    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:36.900270 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.900237    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl" event={"ID":"3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253","Type":"ContainerStarted","Data":"66df10a3440294fafcca3fc9253dd2de526fe571a187dda9ad4a587bb3538efc"}
Jul 17 19:02:36.900424 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.900298    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl" event={"ID":"3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253","Type":"ContainerStarted","Data":"23cc61d020e27a3a531f35fd38b8ff289cfdec89db24cad1cade085c724c362f"}
Jul 17 19:02:36.900424 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.900332    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"
Jul 17 19:02:36.902551 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.902528    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h" event={"ID":"8303fb93-bced-450b-a3db-693bd576c161","Type":"ContainerStarted","Data":"fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e"}
Jul 17 19:02:36.902676 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.902573    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h" event={"ID":"8303fb93-bced-450b-a3db-693bd576c161","Type":"ContainerStarted","Data":"f4fefae96304f606a4db8df8bf973db2a6b1aee86f6eb7954ed7cccbbfe8e71c"}
Jul 17 19:02:36.902676 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.902630    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:36.917908 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.917874    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl" podStartSLOduration=1.9178608320000001 podStartE2EDuration="1.917860832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:02:36.917104275 +0000 UTC m=+468.657857084" watchObservedRunningTime="2026-07-17 19:02:36.917860832 +0000 UTC m=+468.658613641"
Jul 17 19:02:36.935059 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.935022    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h" podStartSLOduration=1.9350099269999999 podStartE2EDuration="1.935009927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:02:36.933664287 +0000 UTC m=+468.674417096" watchObservedRunningTime="2026-07-17 19:02:36.935009927 +0000 UTC m=+468.675762736"
Jul 17 19:02:36.942957 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:36.942926    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:37.275587 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:37.275517    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:37.372817 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:37.372784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:40.066936 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:40.066900    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:40.169088 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:40.169043    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:43.070418 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:43.070386    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:43.171292 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:43.171258    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:46.921271 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:46.921235    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:47.098645 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:47.098594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:47.909736 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:47.909711    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:47.909924 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:47.909778    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lgvnl"
Jul 17 19:02:53.353100 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:53.353064    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"]
Jul 17 19:02:53.353733 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:53.353268    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h" podUID="8303fb93-bced-450b-a3db-693bd576c161" containerName="manager" containerID="cri-o://fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e" gracePeriod=10
Jul 17 19:02:54.442435 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.442384    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:54.566853 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.566830    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjr7l\" (UniqueName: \"kubernetes.io/projected/8303fb93-bced-450b-a3db-693bd576c161-kube-api-access-mjr7l\") pod \"8303fb93-bced-450b-a3db-693bd576c161\" (UID: \"8303fb93-bced-450b-a3db-693bd576c161\") "
Jul 17 19:02:54.566998 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.566888    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8303fb93-bced-450b-a3db-693bd576c161-extensions-socket-volume\") pod \"8303fb93-bced-450b-a3db-693bd576c161\" (UID: \"8303fb93-bced-450b-a3db-693bd576c161\") "
Jul 17 19:02:54.567295 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.567270    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8303fb93-bced-450b-a3db-693bd576c161-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8303fb93-bced-450b-a3db-693bd576c161" (UID: "8303fb93-bced-450b-a3db-693bd576c161"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:02:54.569000 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.568976    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8303fb93-bced-450b-a3db-693bd576c161-kube-api-access-mjr7l" (OuterVolumeSpecName: "kube-api-access-mjr7l") pod "8303fb93-bced-450b-a3db-693bd576c161" (UID: "8303fb93-bced-450b-a3db-693bd576c161"). InnerVolumeSpecName "kube-api-access-mjr7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:02:54.668243 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.668215    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8303fb93-bced-450b-a3db-693bd576c161-extensions-socket-volume\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:02:54.668243 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.668240    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjr7l\" (UniqueName: \"kubernetes.io/projected/8303fb93-bced-450b-a3db-693bd576c161-kube-api-access-mjr7l\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:02:54.994680 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.994595    2558 generic.go:356] "Generic (PLEG): container finished" podID="8303fb93-bced-450b-a3db-693bd576c161" containerID="fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e" exitCode=0
Jul 17 19:02:54.994680 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.994654    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"
Jul 17 19:02:54.994821 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.994701    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h" event={"ID":"8303fb93-bced-450b-a3db-693bd576c161","Type":"ContainerDied","Data":"fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e"}
Jul 17 19:02:54.994821 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.994755    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h" event={"ID":"8303fb93-bced-450b-a3db-693bd576c161","Type":"ContainerDied","Data":"f4fefae96304f606a4db8df8bf973db2a6b1aee86f6eb7954ed7cccbbfe8e71c"}
Jul 17 19:02:54.994821 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:54.994776    2558 scope.go:117] "RemoveContainer" containerID="fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e"
Jul 17 19:02:55.003110 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:55.003091    2558 scope.go:117] "RemoveContainer" containerID="fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e"
Jul 17 19:02:55.003387 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:02:55.003363    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e\": container with ID starting with fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e not found: ID does not exist" containerID="fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e"
Jul 17 19:02:55.003430 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:55.003396    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e"} err="failed to get container status \"fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e\": rpc error: code = NotFound desc = could not find container \"fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e\": container with ID starting with fc089a2b32ca20ed12c5c17ae796b032ee977b13ac5015fad052ae61094d960e not found: ID does not exist"
Jul 17 19:02:55.013050 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:55.013029    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"]
Jul 17 19:02:55.019443 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:55.019420    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjb8h"]
Jul 17 19:02:55.424900 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:55.424879    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:55.524926 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:55.524900    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:02:56.714691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:02:56.714648    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8303fb93-bced-450b-a3db-693bd576c161" path="/var/lib/kubelet/pods/8303fb93-bced-450b-a3db-693bd576c161/volumes"
Jul 17 19:03:00.714675 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:00.714634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:00.775792 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:00.775759    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:04.164984 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:04.164947    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:04.222774 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:04.222739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:07.317760 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:07.317733    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:09.665304 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.665272    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"]
Jul 17 19:03:09.665866 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.665846    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8303fb93-bced-450b-a3db-693bd576c161" containerName="manager"
Jul 17 19:03:09.665954 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.665869    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8303fb93-bced-450b-a3db-693bd576c161" containerName="manager"
Jul 17 19:03:09.666007 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.665951    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8303fb93-bced-450b-a3db-693bd576c161" containerName="manager"
Jul 17 19:03:09.668987 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.668965    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.671514 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.671493    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 19:03:09.671667 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.671617    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xcwj8\""
Jul 17 19:03:09.675813 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.675792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.675936 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.675883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa11453f-12be-47ec-b462-0d99b03644f8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.676000 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.675937    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.676000 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.675966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc96b\" (UniqueName: \"kubernetes.io/projected/fa11453f-12be-47ec-b462-0d99b03644f8-kube-api-access-vc96b\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.676404 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.676012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa11453f-12be-47ec-b462-0d99b03644f8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.676404 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.676048    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.676404 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.676169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa11453f-12be-47ec-b462-0d99b03644f8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.676404 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.676202    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.676404 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.676260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.679279 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.679254    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"]
Jul 17 19:03:09.689313 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.689290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:09.777766 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.777744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa11453f-12be-47ec-b462-0d99b03644f8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.777958 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.777940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778042 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.777970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc96b\" (UniqueName: \"kubernetes.io/projected/fa11453f-12be-47ec-b462-0d99b03644f8-kube-api-access-vc96b\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778042 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa11453f-12be-47ec-b462-0d99b03644f8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778162 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778162 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778089    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa11453f-12be-47ec-b462-0d99b03644f8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778162 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778162 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778372 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778240    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778507 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa11453f-12be-47ec-b462-0d99b03644f8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778573 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778716 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778584    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778716 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778683    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.778716 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.778689    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.780390 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.780368    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa11453f-12be-47ec-b462-0d99b03644f8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.780759 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.780741    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa11453f-12be-47ec-b462-0d99b03644f8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.786162 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.786137    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc96b\" (UniqueName: \"kubernetes.io/projected/fa11453f-12be-47ec-b462-0d99b03644f8-kube-api-access-vc96b\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.786722 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.786702    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa11453f-12be-47ec-b462-0d99b03644f8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vhldp\" (UID: \"fa11453f-12be-47ec-b462-0d99b03644f8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:09.905596 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.905541    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:09.981068 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:09.981002    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:10.114393 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:10.114371    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"]
Jul 17 19:03:10.116695 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:03:10.116668    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa11453f_12be_47ec_b462_0d99b03644f8.slice/crio-606fa1d9f0395fe4fb77cd7fdd21bff5fd0f72dd1091b518c540c1ed355f4c31 WatchSource:0}: Error finding container 606fa1d9f0395fe4fb77cd7fdd21bff5fd0f72dd1091b518c540c1ed355f4c31: Status 404 returned error can't find the container with id 606fa1d9f0395fe4fb77cd7fdd21bff5fd0f72dd1091b518c540c1ed355f4c31
Jul 17 19:03:10.118661 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:10.118629    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:03:10.118776 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:10.118704    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:03:10.118776 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:10.118749    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:03:11.073071 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:11.073028    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp" event={"ID":"fa11453f-12be-47ec-b462-0d99b03644f8","Type":"ContainerStarted","Data":"b7c819529dc7ebb39b5ba912106be318bb05c52d1b2539cae68c75fb5e907834"}
Jul 17 19:03:11.073479 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:11.073089    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp" event={"ID":"fa11453f-12be-47ec-b462-0d99b03644f8","Type":"ContainerStarted","Data":"606fa1d9f0395fe4fb77cd7fdd21bff5fd0f72dd1091b518c540c1ed355f4c31"}
Jul 17 19:03:11.097362 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:11.097318    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp" podStartSLOduration=2.097302499 podStartE2EDuration="2.097302499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:03:11.095842606 +0000 UTC m=+502.836595415" watchObservedRunningTime="2026-07-17 19:03:11.097302499 +0000 UTC m=+502.838055307"
Jul 17 19:03:11.981430 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:11.981395    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:11.986240 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:11.986215    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:12.078002 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:12.077982    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:12.078764 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:12.078748    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:03:16.034120 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.034081    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:16.040382 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.040351    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"]
Jul 17 19:03:16.042721 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.042704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:16.045426 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.045408    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 19:03:16.045672 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.045658    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w799f\""
Jul 17 19:03:16.050438 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.050345    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"]
Jul 17 19:03:16.126489 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.126465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/088168ba-68c1-429a-be98-59dbc4057175-config-file\") pod \"limitador-limitador-64c94fd64f-kwmrx\" (UID: \"088168ba-68c1-429a-be98-59dbc4057175\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:16.126670 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.126508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgtlc\" (UniqueName: \"kubernetes.io/projected/088168ba-68c1-429a-be98-59dbc4057175-kube-api-access-zgtlc\") pod \"limitador-limitador-64c94fd64f-kwmrx\" (UID: \"088168ba-68c1-429a-be98-59dbc4057175\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:16.139148 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.139112    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"]
Jul 17 19:03:16.151172 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.151143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:16.227593 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.227567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgtlc\" (UniqueName: \"kubernetes.io/projected/088168ba-68c1-429a-be98-59dbc4057175-kube-api-access-zgtlc\") pod \"limitador-limitador-64c94fd64f-kwmrx\" (UID: \"088168ba-68c1-429a-be98-59dbc4057175\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:16.227702 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.227664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/088168ba-68c1-429a-be98-59dbc4057175-config-file\") pod \"limitador-limitador-64c94fd64f-kwmrx\" (UID: \"088168ba-68c1-429a-be98-59dbc4057175\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:16.228226 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.228209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/088168ba-68c1-429a-be98-59dbc4057175-config-file\") pod \"limitador-limitador-64c94fd64f-kwmrx\" (UID: \"088168ba-68c1-429a-be98-59dbc4057175\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:16.231789 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.231759    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:16.245896 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.245877    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgtlc\" (UniqueName: \"kubernetes.io/projected/088168ba-68c1-429a-be98-59dbc4057175-kube-api-access-zgtlc\") pod \"limitador-limitador-64c94fd64f-kwmrx\" (UID: \"088168ba-68c1-429a-be98-59dbc4057175\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:16.354969 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.354941    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:16.493490 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.493460    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"]
Jul 17 19:03:16.495081 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:03:16.495048    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088168ba_68c1_429a_be98_59dbc4057175.slice/crio-f1c5b1d1287c8219ec71387839804b4d97d3f27e7029a28a4b3d2fbabf56330d WatchSource:0}: Error finding container f1c5b1d1287c8219ec71387839804b4d97d3f27e7029a28a4b3d2fbabf56330d: Status 404 returned error can't find the container with id f1c5b1d1287c8219ec71387839804b4d97d3f27e7029a28a4b3d2fbabf56330d
Jul 17 19:03:16.868125 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.868097    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wgzgf"]
Jul 17 19:03:16.871494 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.871471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wgzgf"
Jul 17 19:03:16.873926 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.873910    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8m6hx\""
Jul 17 19:03:16.880444 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.880420    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgzgf"]
Jul 17 19:03:16.893267 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.893246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:16.935394 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.935375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd5nk\" (UniqueName: \"kubernetes.io/projected/ce43b400-23ff-47b4-a681-7d93b2e93877-kube-api-access-cd5nk\") pod \"authorino-58cd955675-wgzgf\" (UID: \"ce43b400-23ff-47b4-a681-7d93b2e93877\") " pod="kuadrant-system/authorino-58cd955675-wgzgf"
Jul 17 19:03:16.948417 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:16.948369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:17.036277 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.036249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd5nk\" (UniqueName: \"kubernetes.io/projected/ce43b400-23ff-47b4-a681-7d93b2e93877-kube-api-access-cd5nk\") pod \"authorino-58cd955675-wgzgf\" (UID: \"ce43b400-23ff-47b4-a681-7d93b2e93877\") " pod="kuadrant-system/authorino-58cd955675-wgzgf"
Jul 17 19:03:17.047341 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.047314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd5nk\" (UniqueName: \"kubernetes.io/projected/ce43b400-23ff-47b4-a681-7d93b2e93877-kube-api-access-cd5nk\") pod \"authorino-58cd955675-wgzgf\" (UID: \"ce43b400-23ff-47b4-a681-7d93b2e93877\") " pod="kuadrant-system/authorino-58cd955675-wgzgf"
Jul 17 19:03:17.051533 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.051512    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-btkjq"]
Jul 17 19:03:17.054178 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.054159    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btkjq"
Jul 17 19:03:17.061842 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.061822    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btkjq"]
Jul 17 19:03:17.102791 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.102769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx" event={"ID":"088168ba-68c1-429a-be98-59dbc4057175","Type":"ContainerStarted","Data":"f1c5b1d1287c8219ec71387839804b4d97d3f27e7029a28a4b3d2fbabf56330d"}
Jul 17 19:03:17.137401 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.137354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm8zr\" (UniqueName: \"kubernetes.io/projected/bee213c7-f63a-45aa-8cf1-294802bb212e-kube-api-access-qm8zr\") pod \"authorino-75d556bd77-btkjq\" (UID: \"bee213c7-f63a-45aa-8cf1-294802bb212e\") " pod="kuadrant-system/authorino-75d556bd77-btkjq"
Jul 17 19:03:17.181272 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.181251    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wgzgf"
Jul 17 19:03:17.238029 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.237972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm8zr\" (UniqueName: \"kubernetes.io/projected/bee213c7-f63a-45aa-8cf1-294802bb212e-kube-api-access-qm8zr\") pod \"authorino-75d556bd77-btkjq\" (UID: \"bee213c7-f63a-45aa-8cf1-294802bb212e\") " pod="kuadrant-system/authorino-75d556bd77-btkjq"
Jul 17 19:03:17.248706 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.248683    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm8zr\" (UniqueName: \"kubernetes.io/projected/bee213c7-f63a-45aa-8cf1-294802bb212e-kube-api-access-qm8zr\") pod \"authorino-75d556bd77-btkjq\" (UID: \"bee213c7-f63a-45aa-8cf1-294802bb212e\") " pod="kuadrant-system/authorino-75d556bd77-btkjq"
Jul 17 19:03:17.343930 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.343900    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgzgf"]
Jul 17 19:03:17.347298 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:03:17.347268    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce43b400_23ff_47b4_a681_7d93b2e93877.slice/crio-fd842077f96c3f09158283d83a9b4034c4ab0982701166106cc1394452f5d196 WatchSource:0}: Error finding container fd842077f96c3f09158283d83a9b4034c4ab0982701166106cc1394452f5d196: Status 404 returned error can't find the container with id fd842077f96c3f09158283d83a9b4034c4ab0982701166106cc1394452f5d196
Jul 17 19:03:17.364059 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.364036    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btkjq"
Jul 17 19:03:17.545505 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:17.545283    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btkjq"]
Jul 17 19:03:17.555451 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:03:17.554568    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbee213c7_f63a_45aa_8cf1_294802bb212e.slice/crio-25a2bc35da627f9bcdf00fb08a4600eff3219435e813197097cb8c2710fb096e WatchSource:0}: Error finding container 25a2bc35da627f9bcdf00fb08a4600eff3219435e813197097cb8c2710fb096e: Status 404 returned error can't find the container with id 25a2bc35da627f9bcdf00fb08a4600eff3219435e813197097cb8c2710fb096e
Jul 17 19:03:18.113244 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:18.113174    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btkjq" event={"ID":"bee213c7-f63a-45aa-8cf1-294802bb212e","Type":"ContainerStarted","Data":"25a2bc35da627f9bcdf00fb08a4600eff3219435e813197097cb8c2710fb096e"}
Jul 17 19:03:18.115074 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:18.115016    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wgzgf" event={"ID":"ce43b400-23ff-47b4-a681-7d93b2e93877","Type":"ContainerStarted","Data":"fd842077f96c3f09158283d83a9b4034c4ab0982701166106cc1394452f5d196"}
Jul 17 19:03:22.139364 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:22.139331    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btkjq" event={"ID":"bee213c7-f63a-45aa-8cf1-294802bb212e","Type":"ContainerStarted","Data":"dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb"}
Jul 17 19:03:22.140962 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:22.140936    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wgzgf" event={"ID":"ce43b400-23ff-47b4-a681-7d93b2e93877","Type":"ContainerStarted","Data":"3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0"}
Jul 17 19:03:22.142425 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:22.142400    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx" event={"ID":"088168ba-68c1-429a-be98-59dbc4057175","Type":"ContainerStarted","Data":"2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d"}
Jul 17 19:03:22.142521 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:22.142496    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:22.155833 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:22.155792    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-btkjq" podStartSLOduration=0.929509911 podStartE2EDuration="5.155778913s" totalImagesPullingTime="4.226269002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:03:22.154836102 +0000 UTC m=+513.895588912" watchObservedRunningTime="2026-07-17 19:03:22.155778913 +0000 UTC m=+513.896531721"
Jul 17 19:03:22.171210 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:22.171163    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wgzgf" podStartSLOduration=1.727809897 podStartE2EDuration="6.171151399s" totalImagesPullingTime="4.443341502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:03:22.170345717 +0000 UTC m=+513.911098527" watchObservedRunningTime="2026-07-17 19:03:22.171151399 +0000 UTC m=+513.911904187"
Jul 17 19:03:22.186952 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:22.186911    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx" podStartSLOduration=0.901875676 podStartE2EDuration="6.186899132s" totalImagesPullingTime="5.285023456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:03:22.185935863 +0000 UTC m=+513.926688673" watchObservedRunningTime="2026-07-17 19:03:22.186899132 +0000 UTC m=+513.927651941"
Jul 17 19:03:22.190553 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:22.190531    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgzgf"]
Jul 17 19:03:24.152444 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:24.152401    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wgzgf" podUID="ce43b400-23ff-47b4-a681-7d93b2e93877" containerName="authorino" containerID="cri-o://3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0" gracePeriod=30
Jul 17 19:03:24.400465 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:24.400443    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wgzgf"
Jul 17 19:03:24.503196 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:24.503131    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd5nk\" (UniqueName: \"kubernetes.io/projected/ce43b400-23ff-47b4-a681-7d93b2e93877-kube-api-access-cd5nk\") pod \"ce43b400-23ff-47b4-a681-7d93b2e93877\" (UID: \"ce43b400-23ff-47b4-a681-7d93b2e93877\") "
Jul 17 19:03:24.505178 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:24.505155    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce43b400-23ff-47b4-a681-7d93b2e93877-kube-api-access-cd5nk" (OuterVolumeSpecName: "kube-api-access-cd5nk") pod "ce43b400-23ff-47b4-a681-7d93b2e93877" (UID: "ce43b400-23ff-47b4-a681-7d93b2e93877"). InnerVolumeSpecName "kube-api-access-cd5nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:03:24.604494 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:24.604466    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd5nk\" (UniqueName: \"kubernetes.io/projected/ce43b400-23ff-47b4-a681-7d93b2e93877-kube-api-access-cd5nk\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:03:25.160507 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:25.160475    2558 generic.go:356] "Generic (PLEG): container finished" podID="ce43b400-23ff-47b4-a681-7d93b2e93877" containerID="3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0" exitCode=0
Jul 17 19:03:25.160884 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:25.160534    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wgzgf"
Jul 17 19:03:25.160884 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:25.160566    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wgzgf" event={"ID":"ce43b400-23ff-47b4-a681-7d93b2e93877","Type":"ContainerDied","Data":"3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0"}
Jul 17 19:03:25.160884 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:25.160624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wgzgf" event={"ID":"ce43b400-23ff-47b4-a681-7d93b2e93877","Type":"ContainerDied","Data":"fd842077f96c3f09158283d83a9b4034c4ab0982701166106cc1394452f5d196"}
Jul 17 19:03:25.160884 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:25.160647    2558 scope.go:117] "RemoveContainer" containerID="3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0"
Jul 17 19:03:25.169085 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:25.169066    2558 scope.go:117] "RemoveContainer" containerID="3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0"
Jul 17 19:03:25.169335 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:03:25.169316    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0\": container with ID starting with 3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0 not found: ID does not exist" containerID="3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0"
Jul 17 19:03:25.169383 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:25.169344    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0"} err="failed to get container status \"3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0\": rpc error: code = NotFound desc = could not find container \"3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0\": container with ID starting with 3a88bcd5d5178c6ca6b76a1d0e58da1484e3340f3626ba9350dcb2cec95948f0 not found: ID does not exist"
Jul 17 19:03:25.178097 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:25.178074    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgzgf"]
Jul 17 19:03:25.181326 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:25.181308    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgzgf"]
Jul 17 19:03:26.714568 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:26.714539    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce43b400-23ff-47b4-a681-7d93b2e93877" path="/var/lib/kubelet/pods/ce43b400-23ff-47b4-a681-7d93b2e93877/volumes"
Jul 17 19:03:31.522517 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:31.522481    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"]
Jul 17 19:03:31.522943 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:31.522736    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx" podUID="088168ba-68c1-429a-be98-59dbc4057175" containerName="limitador" containerID="cri-o://2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d" gracePeriod=30
Jul 17 19:03:31.523432 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:31.523365    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:32.074746 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.074722    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:32.161362 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.161296    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/088168ba-68c1-429a-be98-59dbc4057175-config-file\") pod \"088168ba-68c1-429a-be98-59dbc4057175\" (UID: \"088168ba-68c1-429a-be98-59dbc4057175\") "
Jul 17 19:03:32.161485 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.161399    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgtlc\" (UniqueName: \"kubernetes.io/projected/088168ba-68c1-429a-be98-59dbc4057175-kube-api-access-zgtlc\") pod \"088168ba-68c1-429a-be98-59dbc4057175\" (UID: \"088168ba-68c1-429a-be98-59dbc4057175\") "
Jul 17 19:03:32.161647 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.161626    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/088168ba-68c1-429a-be98-59dbc4057175-config-file" (OuterVolumeSpecName: "config-file") pod "088168ba-68c1-429a-be98-59dbc4057175" (UID: "088168ba-68c1-429a-be98-59dbc4057175"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:03:32.163522 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.163498    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/088168ba-68c1-429a-be98-59dbc4057175-kube-api-access-zgtlc" (OuterVolumeSpecName: "kube-api-access-zgtlc") pod "088168ba-68c1-429a-be98-59dbc4057175" (UID: "088168ba-68c1-429a-be98-59dbc4057175"). InnerVolumeSpecName "kube-api-access-zgtlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:03:32.200780 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.200753    2558 generic.go:356] "Generic (PLEG): container finished" podID="088168ba-68c1-429a-be98-59dbc4057175" containerID="2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d" exitCode=0
Jul 17 19:03:32.200882 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.200795    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"
Jul 17 19:03:32.200882 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.200838    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx" event={"ID":"088168ba-68c1-429a-be98-59dbc4057175","Type":"ContainerDied","Data":"2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d"}
Jul 17 19:03:32.200970 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.200890    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kwmrx" event={"ID":"088168ba-68c1-429a-be98-59dbc4057175","Type":"ContainerDied","Data":"f1c5b1d1287c8219ec71387839804b4d97d3f27e7029a28a4b3d2fbabf56330d"}
Jul 17 19:03:32.200970 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.200917    2558 scope.go:117] "RemoveContainer" containerID="2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d"
Jul 17 19:03:32.209903 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.209881    2558 scope.go:117] "RemoveContainer" containerID="2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d"
Jul 17 19:03:32.210132 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:03:32.210114    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d\": container with ID starting with 2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d not found: ID does not exist" containerID="2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d"
Jul 17 19:03:32.210191 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.210144    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d"} err="failed to get container status \"2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d\": rpc error: code = NotFound desc = could not find container \"2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d\": container with ID starting with 2583ca7468ce007210270861c7e10364412b9eda7679bab4fbb0a3b6daa5133d not found: ID does not exist"
Jul 17 19:03:32.222300 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.222281    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"]
Jul 17 19:03:32.228053 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.228031    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kwmrx"]
Jul 17 19:03:32.262339 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.262317    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgtlc\" (UniqueName: \"kubernetes.io/projected/088168ba-68c1-429a-be98-59dbc4057175-kube-api-access-zgtlc\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:03:32.262339 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.262336    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/088168ba-68c1-429a-be98-59dbc4057175-config-file\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:03:32.714487 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:32.714459    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="088168ba-68c1-429a-be98-59dbc4057175" path="/var/lib/kubelet/pods/088168ba-68c1-429a-be98-59dbc4057175/volumes"
Jul 17 19:03:33.310380 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.310351    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:33.413093 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.413063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:33.743619 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.743574    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"]
Jul 17 19:03:33.743963 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.743932    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce43b400-23ff-47b4-a681-7d93b2e93877" containerName="authorino"
Jul 17 19:03:33.743963 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.743944    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce43b400-23ff-47b4-a681-7d93b2e93877" containerName="authorino"
Jul 17 19:03:33.743963 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.743959    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="088168ba-68c1-429a-be98-59dbc4057175" containerName="limitador"
Jul 17 19:03:33.743963 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.743965    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="088168ba-68c1-429a-be98-59dbc4057175" containerName="limitador"
Jul 17 19:03:33.744116 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.744027    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce43b400-23ff-47b4-a681-7d93b2e93877" containerName="authorino"
Jul 17 19:03:33.744116 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.744036    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="088168ba-68c1-429a-be98-59dbc4057175" containerName="limitador"
Jul 17 19:03:33.748326 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.748304    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:33.751161 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.750892    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 19:03:33.751161 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.750908    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 19:03:33.751161 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.751072    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wbd6f\""
Jul 17 19:03:33.751161 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.751080    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 19:03:33.757462 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.757441    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"]
Jul 17 19:03:33.779794 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.779760    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:33.874471 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.874440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbbp\" (UniqueName: \"kubernetes.io/projected/7ed1ca51-2f13-4eea-a978-add90b353c4c-kube-api-access-7dbbp\") pod \"postgres-69fb4594cf-lwzw8\" (UID: \"7ed1ca51-2f13-4eea-a978-add90b353c4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:33.874656 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.874482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7ed1ca51-2f13-4eea-a978-add90b353c4c-data\") pod \"postgres-69fb4594cf-lwzw8\" (UID: \"7ed1ca51-2f13-4eea-a978-add90b353c4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:33.975752 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.975726    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dbbp\" (UniqueName: \"kubernetes.io/projected/7ed1ca51-2f13-4eea-a978-add90b353c4c-kube-api-access-7dbbp\") pod \"postgres-69fb4594cf-lwzw8\" (UID: \"7ed1ca51-2f13-4eea-a978-add90b353c4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:33.975886 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.975762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7ed1ca51-2f13-4eea-a978-add90b353c4c-data\") pod \"postgres-69fb4594cf-lwzw8\" (UID: \"7ed1ca51-2f13-4eea-a978-add90b353c4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:33.976139 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.976124    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7ed1ca51-2f13-4eea-a978-add90b353c4c-data\") pod \"postgres-69fb4594cf-lwzw8\" (UID: \"7ed1ca51-2f13-4eea-a978-add90b353c4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:33.984841 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:33.984814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dbbp\" (UniqueName: \"kubernetes.io/projected/7ed1ca51-2f13-4eea-a978-add90b353c4c-kube-api-access-7dbbp\") pod \"postgres-69fb4594cf-lwzw8\" (UID: \"7ed1ca51-2f13-4eea-a978-add90b353c4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:34.058810 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:34.058753    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:34.188452 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:34.188430    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"]
Jul 17 19:03:34.189660 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:03:34.189633    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed1ca51_2f13_4eea_a978_add90b353c4c.slice/crio-5e448dcea8f14ee439c6230e9c276c43a0185bcae86ddedbd70b5a9259af8065 WatchSource:0}: Error finding container 5e448dcea8f14ee439c6230e9c276c43a0185bcae86ddedbd70b5a9259af8065: Status 404 returned error can't find the container with id 5e448dcea8f14ee439c6230e9c276c43a0185bcae86ddedbd70b5a9259af8065
Jul 17 19:03:34.212657 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:34.212629    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8" event={"ID":"7ed1ca51-2f13-4eea-a978-add90b353c4c","Type":"ContainerStarted","Data":"5e448dcea8f14ee439c6230e9c276c43a0185bcae86ddedbd70b5a9259af8065"}
Jul 17 19:03:39.249956 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:39.249919    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8" event={"ID":"7ed1ca51-2f13-4eea-a978-add90b353c4c","Type":"ContainerStarted","Data":"467b96b0639414e4de0437a53cfba65b4526978a9df8095ac9bc0926756e857d"}
Jul 17 19:03:39.250405 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:39.250044    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:39.268083 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:39.268030    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8" podStartSLOduration=1.6330812670000001 podStartE2EDuration="6.268008984s" totalImagesPullingTime="4.634927717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:03:39.266123648 +0000 UTC m=+531.006876458" watchObservedRunningTime="2026-07-17 19:03:39.268008984 +0000 UTC m=+531.008761794"
Jul 17 19:03:45.285897 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:45.285812    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lwzw8"
Jul 17 19:03:45.616436 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:45.616405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:45.768798 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:45.768765    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:45.847270 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:45.847238    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5z4c"]
Jul 17 19:03:45.853379 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:45.853357    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j5z4c"
Jul 17 19:03:45.860086 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:45.860063    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5z4c"]
Jul 17 19:03:45.988026 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:45.987940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xglzz\" (UniqueName: \"kubernetes.io/projected/fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f-kube-api-access-xglzz\") pod \"authorino-5d4b67c446-j5z4c\" (UID: \"fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f\") " pod="kuadrant-system/authorino-5d4b67c446-j5z4c"
Jul 17 19:03:46.056188 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.056152    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5z4c"]
Jul 17 19:03:46.056424 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:03:46.056401    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xglzz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-j5z4c" podUID="fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f"
Jul 17 19:03:46.088933 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.088902    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xglzz\" (UniqueName: \"kubernetes.io/projected/fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f-kube-api-access-xglzz\") pod \"authorino-5d4b67c446-j5z4c\" (UID: \"fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f\") " pod="kuadrant-system/authorino-5d4b67c446-j5z4c"
Jul 17 19:03:46.092468 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.092444    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-7fzlq"]
Jul 17 19:03:46.096191 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.096172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:46.098890 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.098871    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 19:03:46.100694 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.100675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xglzz\" (UniqueName: \"kubernetes.io/projected/fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f-kube-api-access-xglzz\") pod \"authorino-5d4b67c446-j5z4c\" (UID: \"fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f\") " pod="kuadrant-system/authorino-5d4b67c446-j5z4c"
Jul 17 19:03:46.106452 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.106428    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-7fzlq"]
Jul 17 19:03:46.130092 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.130068    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-7fzlq"]
Jul 17 19:03:46.130320 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:03:46.130302    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wbcgq tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-7fzlq" podUID="81f8a30b-7e03-478d-9da7-2a4aea434146"
Jul 17 19:03:46.161079 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.161053    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8459d7946c-lqsmf"]
Jul 17 19:03:46.164709 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.164695    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:03:46.172937 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.172914    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8459d7946c-lqsmf"]
Jul 17 19:03:46.189456 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.189433    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f8a30b-7e03-478d-9da7-2a4aea434146-tls-cert\") pod \"authorino-76877994-7fzlq\" (UID: \"81f8a30b-7e03-478d-9da7-2a4aea434146\") " pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:46.189569 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.189508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbcgq\" (UniqueName: \"kubernetes.io/projected/81f8a30b-7e03-478d-9da7-2a4aea434146-kube-api-access-wbcgq\") pod \"authorino-76877994-7fzlq\" (UID: \"81f8a30b-7e03-478d-9da7-2a4aea434146\") " pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:46.283382 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.283302    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j5z4c"
Jul 17 19:03:46.283536 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.283302    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:46.289898 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.289877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbcgq\" (UniqueName: \"kubernetes.io/projected/81f8a30b-7e03-478d-9da7-2a4aea434146-kube-api-access-wbcgq\") pod \"authorino-76877994-7fzlq\" (UID: \"81f8a30b-7e03-478d-9da7-2a4aea434146\") " pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:46.290273 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.289935    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f8a30b-7e03-478d-9da7-2a4aea434146-tls-cert\") pod \"authorino-76877994-7fzlq\" (UID: \"81f8a30b-7e03-478d-9da7-2a4aea434146\") " pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:46.290273 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.290031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe172dd5-0fb7-4c30-82dd-59837f685478-tls-cert\") pod \"authorino-8459d7946c-lqsmf\" (UID: \"fe172dd5-0fb7-4c30-82dd-59837f685478\") " pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:03:46.290273 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.290071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krvhj\" (UniqueName: \"kubernetes.io/projected/fe172dd5-0fb7-4c30-82dd-59837f685478-kube-api-access-krvhj\") pod \"authorino-8459d7946c-lqsmf\" (UID: \"fe172dd5-0fb7-4c30-82dd-59837f685478\") " pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:03:46.290374 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.290354    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j5z4c"
Jul 17 19:03:46.292483 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.292462    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f8a30b-7e03-478d-9da7-2a4aea434146-tls-cert\") pod \"authorino-76877994-7fzlq\" (UID: \"81f8a30b-7e03-478d-9da7-2a4aea434146\") " pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:46.293746 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.293730    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:46.298430 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.298405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbcgq\" (UniqueName: \"kubernetes.io/projected/81f8a30b-7e03-478d-9da7-2a4aea434146-kube-api-access-wbcgq\") pod \"authorino-76877994-7fzlq\" (UID: \"81f8a30b-7e03-478d-9da7-2a4aea434146\") " pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:46.390428 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.390390    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xglzz\" (UniqueName: \"kubernetes.io/projected/fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f-kube-api-access-xglzz\") pod \"fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f\" (UID: \"fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f\") "
Jul 17 19:03:46.390639 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.390503    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbcgq\" (UniqueName: \"kubernetes.io/projected/81f8a30b-7e03-478d-9da7-2a4aea434146-kube-api-access-wbcgq\") pod \"81f8a30b-7e03-478d-9da7-2a4aea434146\" (UID: \"81f8a30b-7e03-478d-9da7-2a4aea434146\") "
Jul 17 19:03:46.390725 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.390644    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f8a30b-7e03-478d-9da7-2a4aea434146-tls-cert\") pod \"81f8a30b-7e03-478d-9da7-2a4aea434146\" (UID: \"81f8a30b-7e03-478d-9da7-2a4aea434146\") "
Jul 17 19:03:46.390839 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.390814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe172dd5-0fb7-4c30-82dd-59837f685478-tls-cert\") pod \"authorino-8459d7946c-lqsmf\" (UID: \"fe172dd5-0fb7-4c30-82dd-59837f685478\") " pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:03:46.391020 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.390999    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krvhj\" (UniqueName: \"kubernetes.io/projected/fe172dd5-0fb7-4c30-82dd-59837f685478-kube-api-access-krvhj\") pod \"authorino-8459d7946c-lqsmf\" (UID: \"fe172dd5-0fb7-4c30-82dd-59837f685478\") " pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:03:46.393217 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.393187    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f-kube-api-access-xglzz" (OuterVolumeSpecName: "kube-api-access-xglzz") pod "fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f" (UID: "fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f"). InnerVolumeSpecName "kube-api-access-xglzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:03:46.393318 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.393275    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81f8a30b-7e03-478d-9da7-2a4aea434146-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "81f8a30b-7e03-478d-9da7-2a4aea434146" (UID: "81f8a30b-7e03-478d-9da7-2a4aea434146"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:03:46.393505 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.393485    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81f8a30b-7e03-478d-9da7-2a4aea434146-kube-api-access-wbcgq" (OuterVolumeSpecName: "kube-api-access-wbcgq") pod "81f8a30b-7e03-478d-9da7-2a4aea434146" (UID: "81f8a30b-7e03-478d-9da7-2a4aea434146"). InnerVolumeSpecName "kube-api-access-wbcgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:03:46.393927 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.393911    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe172dd5-0fb7-4c30-82dd-59837f685478-tls-cert\") pod \"authorino-8459d7946c-lqsmf\" (UID: \"fe172dd5-0fb7-4c30-82dd-59837f685478\") " pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:03:46.400677 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.400648    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krvhj\" (UniqueName: \"kubernetes.io/projected/fe172dd5-0fb7-4c30-82dd-59837f685478-kube-api-access-krvhj\") pod \"authorino-8459d7946c-lqsmf\" (UID: \"fe172dd5-0fb7-4c30-82dd-59837f685478\") " pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:03:46.473923 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.473889    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:03:46.492444 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.492419    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbcgq\" (UniqueName: \"kubernetes.io/projected/81f8a30b-7e03-478d-9da7-2a4aea434146-kube-api-access-wbcgq\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:03:46.492444 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.492444    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f8a30b-7e03-478d-9da7-2a4aea434146-tls-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:03:46.492590 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.492459    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xglzz\" (UniqueName: \"kubernetes.io/projected/fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f-kube-api-access-xglzz\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:03:46.608259 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:46.608236    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8459d7946c-lqsmf"]
Jul 17 19:03:46.610313 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:03:46.610281    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe172dd5_0fb7_4c30_82dd_59837f685478.slice/crio-4c983cb7d95845fb4f074899604f014234413d1d9f865b92e75bcad0fca29b32 WatchSource:0}: Error finding container 4c983cb7d95845fb4f074899604f014234413d1d9f865b92e75bcad0fca29b32: Status 404 returned error can't find the container with id 4c983cb7d95845fb4f074899604f014234413d1d9f865b92e75bcad0fca29b32
Jul 17 19:03:47.289470 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.289379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8459d7946c-lqsmf" event={"ID":"fe172dd5-0fb7-4c30-82dd-59837f685478","Type":"ContainerStarted","Data":"98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996"}
Jul 17 19:03:47.289470 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.289428    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8459d7946c-lqsmf" event={"ID":"fe172dd5-0fb7-4c30-82dd-59837f685478","Type":"ContainerStarted","Data":"4c983cb7d95845fb4f074899604f014234413d1d9f865b92e75bcad0fca29b32"}
Jul 17 19:03:47.289703 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.289561    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j5z4c"
Jul 17 19:03:47.289770 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.289707    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-7fzlq"
Jul 17 19:03:47.306555 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.306512    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8459d7946c-lqsmf" podStartSLOduration=0.993453594 podStartE2EDuration="1.306499018s" totalImagesPullingTime="313.045424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:03:47.305954925 +0000 UTC m=+539.046707735" watchObservedRunningTime="2026-07-17 19:03:47.306499018 +0000 UTC m=+539.047251827"
Jul 17 19:03:47.330461 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.330424    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5z4c"]
Jul 17 19:03:47.337509 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.337484    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btkjq"]
Jul 17 19:03:47.337718 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.337681    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-btkjq" podUID="bee213c7-f63a-45aa-8cf1-294802bb212e" containerName="authorino" containerID="cri-o://dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb" gracePeriod=30
Jul 17 19:03:47.343563 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.343536    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5z4c"]
Jul 17 19:03:47.368050 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.368024    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-7fzlq"]
Jul 17 19:03:47.371494 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.371471    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-7fzlq"]
Jul 17 19:03:47.611753 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.611728    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btkjq"
Jul 17 19:03:47.703780 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.703746    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm8zr\" (UniqueName: \"kubernetes.io/projected/bee213c7-f63a-45aa-8cf1-294802bb212e-kube-api-access-qm8zr\") pod \"bee213c7-f63a-45aa-8cf1-294802bb212e\" (UID: \"bee213c7-f63a-45aa-8cf1-294802bb212e\") "
Jul 17 19:03:47.706130 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.706108    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bee213c7-f63a-45aa-8cf1-294802bb212e-kube-api-access-qm8zr" (OuterVolumeSpecName: "kube-api-access-qm8zr") pod "bee213c7-f63a-45aa-8cf1-294802bb212e" (UID: "bee213c7-f63a-45aa-8cf1-294802bb212e"). InnerVolumeSpecName "kube-api-access-qm8zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:03:47.805368 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:47.805339    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm8zr\" (UniqueName: \"kubernetes.io/projected/bee213c7-f63a-45aa-8cf1-294802bb212e-kube-api-access-qm8zr\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:03:48.295565 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.295533    2558 generic.go:356] "Generic (PLEG): container finished" podID="bee213c7-f63a-45aa-8cf1-294802bb212e" containerID="dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb" exitCode=0
Jul 17 19:03:48.295799 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.295578    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btkjq"
Jul 17 19:03:48.295799 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.295627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btkjq" event={"ID":"bee213c7-f63a-45aa-8cf1-294802bb212e","Type":"ContainerDied","Data":"dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb"}
Jul 17 19:03:48.295799 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.295670    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btkjq" event={"ID":"bee213c7-f63a-45aa-8cf1-294802bb212e","Type":"ContainerDied","Data":"25a2bc35da627f9bcdf00fb08a4600eff3219435e813197097cb8c2710fb096e"}
Jul 17 19:03:48.295799 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.295692    2558 scope.go:117] "RemoveContainer" containerID="dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb"
Jul 17 19:03:48.304721 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.304685    2558 scope.go:117] "RemoveContainer" containerID="dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb"
Jul 17 19:03:48.304937 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:03:48.304919    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb\": container with ID starting with dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb not found: ID does not exist" containerID="dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb"
Jul 17 19:03:48.305005 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.304945    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb"} err="failed to get container status \"dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb\": rpc error: code = NotFound desc = could not find container \"dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb\": container with ID starting with dcce11a10c7c9be95645419baf0048c812912ea017d31f51a7cdadc487268ccb not found: ID does not exist"
Jul 17 19:03:48.315743 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.315721    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btkjq"]
Jul 17 19:03:48.319064 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.319045    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btkjq"]
Jul 17 19:03:48.715950 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.715921    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81f8a30b-7e03-478d-9da7-2a4aea434146" path="/var/lib/kubelet/pods/81f8a30b-7e03-478d-9da7-2a4aea434146/volumes"
Jul 17 19:03:48.716153 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.716141    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bee213c7-f63a-45aa-8cf1-294802bb212e" path="/var/lib/kubelet/pods/bee213c7-f63a-45aa-8cf1-294802bb212e/volumes"
Jul 17 19:03:48.716415 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:48.716403    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f" path="/var/lib/kubelet/pods/fb6bbcf2-9b4f-41cc-b2d7-f1eedf3deb6f/volumes"
Jul 17 19:03:51.957373 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:51.957344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:51.990698 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:51.990667    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84fd9fc64b-4kvhp"]
Jul 17 19:03:51.991050 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:51.991034    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee213c7-f63a-45aa-8cf1-294802bb212e" containerName="authorino"
Jul 17 19:03:51.991050 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:51.991050    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee213c7-f63a-45aa-8cf1-294802bb212e" containerName="authorino"
Jul 17 19:03:51.991217 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:51.991126    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bee213c7-f63a-45aa-8cf1-294802bb212e" containerName="authorino"
Jul 17 19:03:52.057024 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.056992    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:52.116733 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.116708    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:52.174711 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.174687    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84fd9fc64b-4kvhp"]
Jul 17 19:03:52.174829 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.174779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:03:52.177026 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.177005    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 19:03:52.177561 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.177541    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 19:03:52.177968 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.177952    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wnxwq\""
Jul 17 19:03:52.326376 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.326302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:52.340480 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.340446    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e377536-1578-4bda-b71c-5a0ca261e6fc-webhook-cert\") pod \"maas-controller-84fd9fc64b-4kvhp\" (UID: \"6e377536-1578-4bda-b71c-5a0ca261e6fc\") " pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:03:52.340623 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.340482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/6e377536-1578-4bda-b71c-5a0ca261e6fc-kube-api-access-hwvzr\") pod \"maas-controller-84fd9fc64b-4kvhp\" (UID: \"6e377536-1578-4bda-b71c-5a0ca261e6fc\") " pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:03:52.441756 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.441729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e377536-1578-4bda-b71c-5a0ca261e6fc-webhook-cert\") pod \"maas-controller-84fd9fc64b-4kvhp\" (UID: \"6e377536-1578-4bda-b71c-5a0ca261e6fc\") " pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:03:52.441884 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.441769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/6e377536-1578-4bda-b71c-5a0ca261e6fc-kube-api-access-hwvzr\") pod \"maas-controller-84fd9fc64b-4kvhp\" (UID: \"6e377536-1578-4bda-b71c-5a0ca261e6fc\") " pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:03:52.444295 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.444273    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e377536-1578-4bda-b71c-5a0ca261e6fc-webhook-cert\") pod \"maas-controller-84fd9fc64b-4kvhp\" (UID: \"6e377536-1578-4bda-b71c-5a0ca261e6fc\") " pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:03:52.451751 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.451733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/6e377536-1578-4bda-b71c-5a0ca261e6fc-kube-api-access-hwvzr\") pod \"maas-controller-84fd9fc64b-4kvhp\" (UID: \"6e377536-1578-4bda-b71c-5a0ca261e6fc\") " pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:03:52.485239 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.485216    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:03:52.646035 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:52.645943    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84fd9fc64b-4kvhp"]
Jul 17 19:03:52.647973 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:03:52.647951    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e377536_1578_4bda_b71c_5a0ca261e6fc.slice/crio-1f258003e4365e57311c0972bad427f5c30614177f3d2094c9f7db581cd0c68f WatchSource:0}: Error finding container 1f258003e4365e57311c0972bad427f5c30614177f3d2094c9f7db581cd0c68f: Status 404 returned error can't find the container with id 1f258003e4365e57311c0972bad427f5c30614177f3d2094c9f7db581cd0c68f
Jul 17 19:03:53.320668 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:53.320624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp" event={"ID":"6e377536-1578-4bda-b71c-5a0ca261e6fc","Type":"ContainerStarted","Data":"1f258003e4365e57311c0972bad427f5c30614177f3d2094c9f7db581cd0c68f"}
Jul 17 19:03:55.112838 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:55.112747    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:55.205760 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:55.205676    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:03:55.336271 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:55.336241    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp" event={"ID":"6e377536-1578-4bda-b71c-5a0ca261e6fc","Type":"ContainerStarted","Data":"86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689"}
Jul 17 19:03:55.336442 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:55.336373    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:03:55.355502 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:03:55.355445    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp" podStartSLOduration=2.104888641 podStartE2EDuration="4.355430961s" totalImagesPullingTime="2.25054232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:03:55.353329723 +0000 UTC m=+547.094082531" watchObservedRunningTime="2026-07-17 19:03:55.355430961 +0000 UTC m=+547.096183769"
Jul 17 19:04:06.283062 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.283029    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84fd9fc64b-4kvhp"]
Jul 17 19:04:06.283488 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.283241    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp" podUID="6e377536-1578-4bda-b71c-5a0ca261e6fc" containerName="manager" containerID="cri-o://86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689" gracePeriod=30
Jul 17 19:04:06.285020 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.284988    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:04:06.534260 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.534208    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:04:06.559210 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.559190    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/6e377536-1578-4bda-b71c-5a0ca261e6fc-kube-api-access-hwvzr\") pod \"6e377536-1578-4bda-b71c-5a0ca261e6fc\" (UID: \"6e377536-1578-4bda-b71c-5a0ca261e6fc\") "
Jul 17 19:04:06.559282 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.559249    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e377536-1578-4bda-b71c-5a0ca261e6fc-webhook-cert\") pod \"6e377536-1578-4bda-b71c-5a0ca261e6fc\" (UID: \"6e377536-1578-4bda-b71c-5a0ca261e6fc\") "
Jul 17 19:04:06.561391 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.561359    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e377536-1578-4bda-b71c-5a0ca261e6fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6e377536-1578-4bda-b71c-5a0ca261e6fc" (UID: "6e377536-1578-4bda-b71c-5a0ca261e6fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:04:06.561472 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.561412    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e377536-1578-4bda-b71c-5a0ca261e6fc-kube-api-access-hwvzr" (OuterVolumeSpecName: "kube-api-access-hwvzr") pod "6e377536-1578-4bda-b71c-5a0ca261e6fc" (UID: "6e377536-1578-4bda-b71c-5a0ca261e6fc"). InnerVolumeSpecName "kube-api-access-hwvzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:04:06.660432 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.660408    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/6e377536-1578-4bda-b71c-5a0ca261e6fc-kube-api-access-hwvzr\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:04:06.660432 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:06.660430    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e377536-1578-4bda-b71c-5a0ca261e6fc-webhook-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:04:07.390757 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:07.390716    2558 generic.go:356] "Generic (PLEG): container finished" podID="6e377536-1578-4bda-b71c-5a0ca261e6fc" containerID="86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689" exitCode=0
Jul 17 19:04:07.391154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:07.390783    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp"
Jul 17 19:04:07.391154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:07.390806    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp" event={"ID":"6e377536-1578-4bda-b71c-5a0ca261e6fc","Type":"ContainerDied","Data":"86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689"}
Jul 17 19:04:07.391154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:07.390862    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84fd9fc64b-4kvhp" event={"ID":"6e377536-1578-4bda-b71c-5a0ca261e6fc","Type":"ContainerDied","Data":"1f258003e4365e57311c0972bad427f5c30614177f3d2094c9f7db581cd0c68f"}
Jul 17 19:04:07.391154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:07.390891    2558 scope.go:117] "RemoveContainer" containerID="86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689"
Jul 17 19:04:07.399348 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:07.399333    2558 scope.go:117] "RemoveContainer" containerID="86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689"
Jul 17 19:04:07.399593 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:04:07.399574    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689\": container with ID starting with 86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689 not found: ID does not exist" containerID="86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689"
Jul 17 19:04:07.399661 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:07.399624    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689"} err="failed to get container status \"86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689\": rpc error: code = NotFound desc = could not find container \"86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689\": container with ID starting with 86e3a1953d8f2708d29c14df9f2c02462dc9896216ef0343cace2d0892a5f689 not found: ID does not exist"
Jul 17 19:04:07.406668 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:07.406646    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84fd9fc64b-4kvhp"]
Jul 17 19:04:07.410832 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:07.410813    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84fd9fc64b-4kvhp"]
Jul 17 19:04:08.714795 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:08.714764    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e377536-1578-4bda-b71c-5a0ca261e6fc" path="/var/lib/kubelet/pods/6e377536-1578-4bda-b71c-5a0ca261e6fc/volumes"
Jul 17 19:04:16.566143 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:16.566110    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:16.700893 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:16.700847    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:26.757539 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:26.757509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:26.864147 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:26.864118    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:27.359917 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.359879    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"]
Jul 17 19:04:27.360323 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.360305    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e377536-1578-4bda-b71c-5a0ca261e6fc" containerName="manager"
Jul 17 19:04:27.360418 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.360325    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e377536-1578-4bda-b71c-5a0ca261e6fc" containerName="manager"
Jul 17 19:04:27.360473 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.360417    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e377536-1578-4bda-b71c-5a0ca261e6fc" containerName="manager"
Jul 17 19:04:27.361595 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.361565    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:27.363863 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.363846    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:27.366210 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.366194    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 19:04:27.375158 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.375139    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"]
Jul 17 19:04:27.427955 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.427932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6709a9-c881-4925-ad89-7c20f812c612-maas-api-tls\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:27.428099 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.427972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcqdb\" (UniqueName: \"kubernetes.io/projected/5c6709a9-c881-4925-ad89-7c20f812c612-kube-api-access-xcqdb\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:27.428099 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.428001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6709a9-c881-4925-ad89-7c20f812c612-openshift-service-ca\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:27.529258 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.529228    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6709a9-c881-4925-ad89-7c20f812c612-maas-api-tls\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:27.529436 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.529279    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcqdb\" (UniqueName: \"kubernetes.io/projected/5c6709a9-c881-4925-ad89-7c20f812c612-kube-api-access-xcqdb\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:27.529436 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.529314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6709a9-c881-4925-ad89-7c20f812c612-openshift-service-ca\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:27.529436 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:04:27.529389    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 17 19:04:27.529641 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:04:27.529472    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6709a9-c881-4925-ad89-7c20f812c612-maas-api-tls podName:5c6709a9-c881-4925-ad89-7c20f812c612 nodeName:}" failed. No retries permitted until 2026-07-17 19:04:28.029451929 +0000 UTC m=+579.770204733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c6709a9-c881-4925-ad89-7c20f812c612-maas-api-tls") pod "maas-api-59dfc85689-js4c2" (UID: "5c6709a9-c881-4925-ad89-7c20f812c612") : secret "maas-api-serving-cert" not found
Jul 17 19:04:27.529940 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.529924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6709a9-c881-4925-ad89-7c20f812c612-openshift-service-ca\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:27.539847 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.539827    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcqdb\" (UniqueName: \"kubernetes.io/projected/5c6709a9-c881-4925-ad89-7c20f812c612-kube-api-access-xcqdb\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:27.665551 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.665484    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:27.829923 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.829892    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:27.925624 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.925520    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:27.959578 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.959550    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-7m545"]
Jul 17 19:04:27.963009 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.962993    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:27.965251 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.965230    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 19:04:27.965357 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.965332    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n56hd\""
Jul 17 19:04:27.973524 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:27.973506    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-7m545"]
Jul 17 19:04:28.032821 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.032796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6709a9-c881-4925-ad89-7c20f812c612-maas-api-tls\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:28.032934 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.032837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62c40740-88f8-40fe-91d7-318b5986ef97-plugins-config-volume\") pod \"payload-processing-5bf47cd988-7m545\" (UID: \"62c40740-88f8-40fe-91d7-318b5986ef97\") " pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:28.032934 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.032885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pbmh\" (UniqueName: \"kubernetes.io/projected/62c40740-88f8-40fe-91d7-318b5986ef97-kube-api-access-8pbmh\") pod \"payload-processing-5bf47cd988-7m545\" (UID: \"62c40740-88f8-40fe-91d7-318b5986ef97\") " pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:28.035072 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.035047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6709a9-c881-4925-ad89-7c20f812c612-maas-api-tls\") pod \"maas-api-59dfc85689-js4c2\" (UID: \"5c6709a9-c881-4925-ad89-7c20f812c612\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:28.133266 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.133231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pbmh\" (UniqueName: \"kubernetes.io/projected/62c40740-88f8-40fe-91d7-318b5986ef97-kube-api-access-8pbmh\") pod \"payload-processing-5bf47cd988-7m545\" (UID: \"62c40740-88f8-40fe-91d7-318b5986ef97\") " pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:28.133410 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.133293    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62c40740-88f8-40fe-91d7-318b5986ef97-plugins-config-volume\") pod \"payload-processing-5bf47cd988-7m545\" (UID: \"62c40740-88f8-40fe-91d7-318b5986ef97\") " pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:28.133978 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.133958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62c40740-88f8-40fe-91d7-318b5986ef97-plugins-config-volume\") pod \"payload-processing-5bf47cd988-7m545\" (UID: \"62c40740-88f8-40fe-91d7-318b5986ef97\") " pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:28.142284 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.142259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pbmh\" (UniqueName: \"kubernetes.io/projected/62c40740-88f8-40fe-91d7-318b5986ef97-kube-api-access-8pbmh\") pod \"payload-processing-5bf47cd988-7m545\" (UID: \"62c40740-88f8-40fe-91d7-318b5986ef97\") " pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:28.274159 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.274087    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:28.274159 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.274133    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:28.426367 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.426337    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-7m545"]
Jul 17 19:04:28.430309 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:04:28.430274    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c40740_88f8_40fe_91d7_318b5986ef97.slice/crio-5497e1b1589d3b7907f5383c29c2223c3c31aa9746c574adc751933aa35be8cd WatchSource:0}: Error finding container 5497e1b1589d3b7907f5383c29c2223c3c31aa9746c574adc751933aa35be8cd: Status 404 returned error can't find the container with id 5497e1b1589d3b7907f5383c29c2223c3c31aa9746c574adc751933aa35be8cd
Jul 17 19:04:28.455761 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.455739    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"]
Jul 17 19:04:28.457903 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:04:28.457882    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6709a9_c881_4925_ad89_7c20f812c612.slice/crio-059440a20a244e24e8bf669630b7cc3b15605eae2e297ae72fb50382bb274adc WatchSource:0}: Error finding container 059440a20a244e24e8bf669630b7cc3b15605eae2e297ae72fb50382bb274adc: Status 404 returned error can't find the container with id 059440a20a244e24e8bf669630b7cc3b15605eae2e297ae72fb50382bb274adc
Jul 17 19:04:28.492027 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.491989    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-7m545" event={"ID":"62c40740-88f8-40fe-91d7-318b5986ef97","Type":"ContainerStarted","Data":"5497e1b1589d3b7907f5383c29c2223c3c31aa9746c574adc751933aa35be8cd"}
Jul 17 19:04:28.493101 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:28.493077    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2" event={"ID":"5c6709a9-c881-4925-ad89-7c20f812c612","Type":"ContainerStarted","Data":"059440a20a244e24e8bf669630b7cc3b15605eae2e297ae72fb50382bb274adc"}
Jul 17 19:04:32.518906 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:32.518874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-7m545" event={"ID":"62c40740-88f8-40fe-91d7-318b5986ef97","Type":"ContainerStarted","Data":"c047f884d0941c495298d59f3195a969d9567aacf69edf0199d5d13c608db110"}
Jul 17 19:04:32.519330 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:32.518967    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:32.520448 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:32.520427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2" event={"ID":"5c6709a9-c881-4925-ad89-7c20f812c612","Type":"ContainerStarted","Data":"466de015d58dd0dc71e2d59441d6ee8acbc77abf892b42230eb48959a573f395"}
Jul 17 19:04:32.520561 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:32.520466    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:32.540364 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:32.540320    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-7m545" podStartSLOduration=2.263797736 podStartE2EDuration="5.540306594s" totalImagesPullingTime="3.276508858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:04:32.538218004 +0000 UTC m=+584.278970828" watchObservedRunningTime="2026-07-17 19:04:32.540306594 +0000 UTC m=+584.281059402"
Jul 17 19:04:32.559582 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:32.559517    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2" podStartSLOduration=2.375157127 podStartE2EDuration="5.559499553s" totalImagesPullingTime="3.184342426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:04:32.556825423 +0000 UTC m=+584.297578233" watchObservedRunningTime="2026-07-17 19:04:32.559499553 +0000 UTC m=+584.300252363"
Jul 17 19:04:35.537786 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:35.537759    2558 generic.go:356] "Generic (PLEG): container finished" podID="fa11453f-12be-47ec-b462-0d99b03644f8" containerID="b7c819529dc7ebb39b5ba912106be318bb05c52d1b2539cae68c75fb5e907834" exitCode=0
Jul 17 19:04:35.538113 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:35.537826    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp" event={"ID":"fa11453f-12be-47ec-b462-0d99b03644f8","Type":"ContainerDied","Data":"b7c819529dc7ebb39b5ba912106be318bb05c52d1b2539cae68c75fb5e907834"}
Jul 17 19:04:35.538161 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:35.538154    2558 scope.go:117] "RemoveContainer" containerID="b7c819529dc7ebb39b5ba912106be318bb05c52d1b2539cae68c75fb5e907834"
Jul 17 19:04:35.539045 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:35.539019    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:04:35.539101 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:35.539089    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:04:35.539143 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:35.539130    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:04:36.544966 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:36.544933    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp" event={"ID":"fa11453f-12be-47ec-b462-0d99b03644f8","Type":"ContainerStarted","Data":"ec9f7e54552d181da444b7a06fc535fef866e6018464abdd6b3462f826982550"}
Jul 17 19:04:36.981878 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:36.981841    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:04:36.982143 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:36.982123    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vhldp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 17 19:04:36.982191 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:36.982171    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp" podUID="fa11453f-12be-47ec-b462-0d99b03644f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 17 19:04:37.981285 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:37.981255    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vhldp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 17 19:04:37.981688 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:37.981302    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp" podUID="fa11453f-12be-47ec-b462-0d99b03644f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 17 19:04:38.531373 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:38.531344    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59dfc85689-js4c2"
Jul 17 19:04:38.981913 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:38.981878    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vhldp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 17 19:04:38.982300 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:38.981930    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp" podUID="fa11453f-12be-47ec-b462-0d99b03644f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 17 19:04:39.507142 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:39.507105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:39.602933 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:39.602898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:39.982303 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:39.982264    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vhldp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 17 19:04:39.982808 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:39.982323    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp" podUID="fa11453f-12be-47ec-b462-0d99b03644f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 17 19:04:40.985853 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:40.985823    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:04:40.986297 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:40.986277    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:04:40.987027 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:40.987003    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vhldp"
Jul 17 19:04:43.528072 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:43.528045    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-7m545"
Jul 17 19:04:44.491447 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.491414    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"]
Jul 17 19:04:44.494764 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.494748    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.497256 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.497208    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 19:04:44.498215 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.498147    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 19:04:44.498215 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.498155    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4fjw6\""
Jul 17 19:04:44.498215 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.498179    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 17 19:04:44.504408 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.504386    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"]
Jul 17 19:04:44.602256 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.602235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.602638 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.602266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq5pk\" (UniqueName: \"kubernetes.io/projected/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-kube-api-access-hq5pk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.602638 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.602304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.602638 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.602364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.602638 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.602405    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.602638 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.602499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.649577 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.649549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:44.703716 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.703689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.703832 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.703772    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.703832 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.703811    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.703942 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.703834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq5pk\" (UniqueName: \"kubernetes.io/projected/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-kube-api-access-hq5pk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.703942 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.703868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.703942 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.703901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.704156 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.704135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.704240 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.704221    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.704289 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.704259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.706070 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.706046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.706315 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.706298    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.712260 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.712241    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq5pk\" (UniqueName: \"kubernetes.io/projected/b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52-kube-api-access-hq5pk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf\" (UID: \"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.808007 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.807946    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:44.955164 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:44.955136    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"]
Jul 17 19:04:44.956934 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:04:44.956898    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c358ec_bf9a_4a3d_bb8f_8c9957f99e52.slice/crio-a3b62580efeec6380bef34b684fd092e878d8003085c9ea04d0b61728463206e WatchSource:0}: Error finding container a3b62580efeec6380bef34b684fd092e878d8003085c9ea04d0b61728463206e: Status 404 returned error can't find the container with id a3b62580efeec6380bef34b684fd092e878d8003085c9ea04d0b61728463206e
Jul 17 19:04:45.601976 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:45.601939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf" event={"ID":"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52","Type":"ContainerStarted","Data":"a3b62580efeec6380bef34b684fd092e878d8003085c9ea04d0b61728463206e"}
Jul 17 19:04:46.608590 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:46.608552    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf" event={"ID":"b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52","Type":"ContainerStarted","Data":"eacdc9265f422be75d79d039cc8df399a2c80dd790f2908e9b2d865511145572"}
Jul 17 19:04:46.629891 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:46.629725    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf" podStartSLOduration=1.409796566 podStartE2EDuration="2.629708101s" totalImagesPullingTime="1.219911535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:04:46.629388627 +0000 UTC m=+598.370141438" watchObservedRunningTime="2026-07-17 19:04:46.629708101 +0000 UTC m=+598.370460911"
Jul 17 19:04:48.656881 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:48.656857    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:04:48.657267 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:48.657093    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:04:48.664132 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:48.664113    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:04:48.664307 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:48.664293    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:04:54.808376 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:54.808342    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:54.808837 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:54.808406    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:54.820891 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:54.820871    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:04:55.617393 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:55.617360    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:04:55.664685 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:04:55.664659    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf"
Jul 17 19:05:05.005731 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:05.005694    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:05:05.640486 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:05.640446    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:05:08.613372 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.613334    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"]
Jul 17 19:05:08.621117 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.621093    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.623575 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.623538    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 19:05:08.623873 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.623854    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"]
Jul 17 19:05:08.634377 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.634356    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:05:08.692316 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.692291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.692428 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.692336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.692428 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.692360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.692428 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.692377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqmf6\" (UniqueName: \"kubernetes.io/projected/eb8fc268-707c-422d-b631-088679fce0e4-kube-api-access-jqmf6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.692560 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.692448    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.692560 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.692478    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8fc268-707c-422d-b631-088679fce0e4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.793874 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.793848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.794016 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.793885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.794016 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.793905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqmf6\" (UniqueName: \"kubernetes.io/projected/eb8fc268-707c-422d-b631-088679fce0e4-kube-api-access-jqmf6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.794143 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.794121    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.794203 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.794184    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8fc268-707c-422d-b631-088679fce0e4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.794311 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.794296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.794390 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.794320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.794480 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.794459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.794611 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.794583    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.796222 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.796202    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8fc268-707c-422d-b631-088679fce0e4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.796880 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.796861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8fc268-707c-422d-b631-088679fce0e4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.802044 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.802022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqmf6\" (UniqueName: \"kubernetes.io/projected/eb8fc268-707c-422d-b631-088679fce0e4-kube-api-access-jqmf6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq\" (UID: \"eb8fc268-707c-422d-b631-088679fce0e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:08.932490 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:08.932427    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:09.066250 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:09.066223    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"]
Jul 17 19:05:09.068094 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:05:09.068066    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8fc268_707c_422d_b631_088679fce0e4.slice/crio-d0e0f4e3c4363c3b03c1b69639d7500bf3c972608a43436c29ed189ba7b10200 WatchSource:0}: Error finding container d0e0f4e3c4363c3b03c1b69639d7500bf3c972608a43436c29ed189ba7b10200: Status 404 returned error can't find the container with id d0e0f4e3c4363c3b03c1b69639d7500bf3c972608a43436c29ed189ba7b10200
Jul 17 19:05:09.728371 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:09.728340    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq" event={"ID":"eb8fc268-707c-422d-b631-088679fce0e4","Type":"ContainerStarted","Data":"115c5a2ef73f17557a01686574bd6d80cd48a922787904654d1d8bf12455a7fd"}
Jul 17 19:05:09.728786 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:09.728392    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq" event={"ID":"eb8fc268-707c-422d-b631-088679fce0e4","Type":"ContainerStarted","Data":"d0e0f4e3c4363c3b03c1b69639d7500bf3c972608a43436c29ed189ba7b10200"}
Jul 17 19:05:09.747126 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:09.747079    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq" podStartSLOduration=1.574038413 podStartE2EDuration="1.74705499s" totalImagesPullingTime="173.016577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:05:09.745708194 +0000 UTC m=+621.486461003" watchObservedRunningTime="2026-07-17 19:05:09.74705499 +0000 UTC m=+621.487807798"
Jul 17 19:05:15.406315 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.406246    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"]
Jul 17 19:05:15.409158 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.409136    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.411815 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.411791    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 17 19:05:15.421380 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.421359    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"]
Jul 17 19:05:15.429911 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.429887    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:05:15.450795 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.450769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.450899 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.450807    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.450899 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.450822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.450899 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.450859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvmj5\" (UniqueName: \"kubernetes.io/projected/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-kube-api-access-pvmj5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.451022 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.450902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.451022 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.450930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.552063 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.552034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.552149 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.552073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.552149 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.552115    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmj5\" (UniqueName: \"kubernetes.io/projected/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-kube-api-access-pvmj5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.552233 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.552166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.552233 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.552208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.552331 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.552263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.552457 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.552437    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.552520 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.552492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.552575 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.552532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.554471 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.554452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.554874 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.554853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.560934 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.560912    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvmj5\" (UniqueName: \"kubernetes.io/projected/b00abe18-f8a8-4d39-bbfb-01d7622edc3b-kube-api-access-pvmj5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x6qwn\" (UID: \"b00abe18-f8a8-4d39-bbfb-01d7622edc3b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.720108 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.720039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:15.855034 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.855005    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"]
Jul 17 19:05:15.856909 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:05:15.856882    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00abe18_f8a8_4d39_bbfb_01d7622edc3b.slice/crio-45cf0635f6f3435053e5745c99b6f798110f3a5d5cfe8f677d19e4bd9727f727 WatchSource:0}: Error finding container 45cf0635f6f3435053e5745c99b6f798110f3a5d5cfe8f677d19e4bd9727f727: Status 404 returned error can't find the container with id 45cf0635f6f3435053e5745c99b6f798110f3a5d5cfe8f677d19e4bd9727f727
Jul 17 19:05:15.858244 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:15.858227    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 19:05:16.763579 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:16.763546    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn" event={"ID":"b00abe18-f8a8-4d39-bbfb-01d7622edc3b","Type":"ContainerStarted","Data":"8b3939b888ce97b42794ec0b675524b4762c0c02637ec3e330ea0add3e513363"}
Jul 17 19:05:16.763987 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:16.763592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn" event={"ID":"b00abe18-f8a8-4d39-bbfb-01d7622edc3b","Type":"ContainerStarted","Data":"45cf0635f6f3435053e5745c99b6f798110f3a5d5cfe8f677d19e4bd9727f727"}
Jul 17 19:05:16.784083 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:16.784033    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn" podStartSLOduration=1.5770590549999999 podStartE2EDuration="1.784017817s" totalImagesPullingTime="206.958762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:05:16.782305193 +0000 UTC m=+628.523058003" watchObservedRunningTime="2026-07-17 19:05:16.784017817 +0000 UTC m=+628.524770626"
Jul 17 19:05:18.933458 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:18.933423    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:18.933862 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:18.933499    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:18.951215 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:18.951189    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:19.788417 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:19.788392    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq"
Jul 17 19:05:23.534983 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:23.534948    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:05:25.720442 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:25.720408    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:25.720833 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:25.720472    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:25.733010 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:25.732988    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:25.819144 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:25.819109    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x6qwn"
Jul 17 19:05:41.218891 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:41.218864    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:05:57.711287 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:57.711248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:05:57.773812 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:05:57.773778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:06:32.486218 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.486183    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79698fdf5d-6nt4d"]
Jul 17 19:06:32.488902 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.488887    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79698fdf5d-6nt4d"
Jul 17 19:06:32.500029 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.500004    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79698fdf5d-6nt4d"]
Jul 17 19:06:32.573725 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.573698    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqpsg\" (UniqueName: \"kubernetes.io/projected/c3d4154f-6fc4-43cb-b7c2-83d08f06fce4-kube-api-access-fqpsg\") pod \"authorino-79698fdf5d-6nt4d\" (UID: \"c3d4154f-6fc4-43cb-b7c2-83d08f06fce4\") " pod="kuadrant-system/authorino-79698fdf5d-6nt4d"
Jul 17 19:06:32.573860 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.573787    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c3d4154f-6fc4-43cb-b7c2-83d08f06fce4-tls-cert\") pod \"authorino-79698fdf5d-6nt4d\" (UID: \"c3d4154f-6fc4-43cb-b7c2-83d08f06fce4\") " pod="kuadrant-system/authorino-79698fdf5d-6nt4d"
Jul 17 19:06:32.674460 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.674429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqpsg\" (UniqueName: \"kubernetes.io/projected/c3d4154f-6fc4-43cb-b7c2-83d08f06fce4-kube-api-access-fqpsg\") pod \"authorino-79698fdf5d-6nt4d\" (UID: \"c3d4154f-6fc4-43cb-b7c2-83d08f06fce4\") " pod="kuadrant-system/authorino-79698fdf5d-6nt4d"
Jul 17 19:06:32.674617 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.674563    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c3d4154f-6fc4-43cb-b7c2-83d08f06fce4-tls-cert\") pod \"authorino-79698fdf5d-6nt4d\" (UID: \"c3d4154f-6fc4-43cb-b7c2-83d08f06fce4\") " pod="kuadrant-system/authorino-79698fdf5d-6nt4d"
Jul 17 19:06:32.677022 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.677002    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c3d4154f-6fc4-43cb-b7c2-83d08f06fce4-tls-cert\") pod \"authorino-79698fdf5d-6nt4d\" (UID: \"c3d4154f-6fc4-43cb-b7c2-83d08f06fce4\") " pod="kuadrant-system/authorino-79698fdf5d-6nt4d"
Jul 17 19:06:32.685087 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.685064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqpsg\" (UniqueName: \"kubernetes.io/projected/c3d4154f-6fc4-43cb-b7c2-83d08f06fce4-kube-api-access-fqpsg\") pod \"authorino-79698fdf5d-6nt4d\" (UID: \"c3d4154f-6fc4-43cb-b7c2-83d08f06fce4\") " pod="kuadrant-system/authorino-79698fdf5d-6nt4d"
Jul 17 19:06:32.797929 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.797869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79698fdf5d-6nt4d"
Jul 17 19:06:32.857508 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.857460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:06:32.936820 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.936796    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79698fdf5d-6nt4d"]
Jul 17 19:06:32.938344 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:06:32.938318    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3d4154f_6fc4_43cb_b7c2_83d08f06fce4.slice/crio-4a1dad9f5c5907a8cc0d2cb5c8f82fb056902c3ab8d3d7f8772964eabda5a8f6 WatchSource:0}: Error finding container 4a1dad9f5c5907a8cc0d2cb5c8f82fb056902c3ab8d3d7f8772964eabda5a8f6: Status 404 returned error can't find the container with id 4a1dad9f5c5907a8cc0d2cb5c8f82fb056902c3ab8d3d7f8772964eabda5a8f6
Jul 17 19:06:32.939737 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:32.939709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:06:33.131148 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:33.131124    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79698fdf5d-6nt4d" event={"ID":"c3d4154f-6fc4-43cb-b7c2-83d08f06fce4","Type":"ContainerStarted","Data":"4a1dad9f5c5907a8cc0d2cb5c8f82fb056902c3ab8d3d7f8772964eabda5a8f6"}
Jul 17 19:06:33.993663 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:33.993592    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:06:34.086583 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.086543    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:06:34.140402 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.140334    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79698fdf5d-6nt4d" event={"ID":"c3d4154f-6fc4-43cb-b7c2-83d08f06fce4","Type":"ContainerStarted","Data":"5c80e4182a75b6d832f32a3a822191770194dc4fe335e8ac73d508c5726ba418"}
Jul 17 19:06:34.191099 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.190304    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79698fdf5d-6nt4d" podStartSLOduration=1.776364126 podStartE2EDuration="2.190279387s" totalImagesPullingTime="413.915261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:06:34.160562087 +0000 UTC m=+705.901314888" watchObservedRunningTime="2026-07-17 19:06:34.190279387 +0000 UTC m=+705.931032196"
Jul 17 19:06:34.191099 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.190973    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8459d7946c-lqsmf"]
Jul 17 19:06:34.191351 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.191206    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8459d7946c-lqsmf" podUID="fe172dd5-0fb7-4c30-82dd-59837f685478" containerName="authorino" containerID="cri-o://98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996" gracePeriod=30
Jul 17 19:06:34.465814 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.465791    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:06:34.591835 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.591802    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe172dd5-0fb7-4c30-82dd-59837f685478-tls-cert\") pod \"fe172dd5-0fb7-4c30-82dd-59837f685478\" (UID: \"fe172dd5-0fb7-4c30-82dd-59837f685478\") "
Jul 17 19:06:34.591988 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.591917    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krvhj\" (UniqueName: \"kubernetes.io/projected/fe172dd5-0fb7-4c30-82dd-59837f685478-kube-api-access-krvhj\") pod \"fe172dd5-0fb7-4c30-82dd-59837f685478\" (UID: \"fe172dd5-0fb7-4c30-82dd-59837f685478\") "
Jul 17 19:06:34.594046 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.594017    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe172dd5-0fb7-4c30-82dd-59837f685478-kube-api-access-krvhj" (OuterVolumeSpecName: "kube-api-access-krvhj") pod "fe172dd5-0fb7-4c30-82dd-59837f685478" (UID: "fe172dd5-0fb7-4c30-82dd-59837f685478"). InnerVolumeSpecName "kube-api-access-krvhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:06:34.604920 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.604896    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe172dd5-0fb7-4c30-82dd-59837f685478-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fe172dd5-0fb7-4c30-82dd-59837f685478" (UID: "fe172dd5-0fb7-4c30-82dd-59837f685478"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:06:34.693126 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.693095    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krvhj\" (UniqueName: \"kubernetes.io/projected/fe172dd5-0fb7-4c30-82dd-59837f685478-kube-api-access-krvhj\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:06:34.693126 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:34.693127    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe172dd5-0fb7-4c30-82dd-59837f685478-tls-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:06:35.146581 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.146547    2558 generic.go:356] "Generic (PLEG): container finished" podID="fe172dd5-0fb7-4c30-82dd-59837f685478" containerID="98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996" exitCode=0
Jul 17 19:06:35.147047 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.146593    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8459d7946c-lqsmf"
Jul 17 19:06:35.147047 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.146587    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8459d7946c-lqsmf" event={"ID":"fe172dd5-0fb7-4c30-82dd-59837f685478","Type":"ContainerDied","Data":"98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996"}
Jul 17 19:06:35.147047 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.146655    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8459d7946c-lqsmf" event={"ID":"fe172dd5-0fb7-4c30-82dd-59837f685478","Type":"ContainerDied","Data":"4c983cb7d95845fb4f074899604f014234413d1d9f865b92e75bcad0fca29b32"}
Jul 17 19:06:35.147047 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.146672    2558 scope.go:117] "RemoveContainer" containerID="98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996"
Jul 17 19:06:35.155683 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.155665    2558 scope.go:117] "RemoveContainer" containerID="98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996"
Jul 17 19:06:35.155923 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:06:35.155907    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996\": container with ID starting with 98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996 not found: ID does not exist" containerID="98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996"
Jul 17 19:06:35.155979 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.155930    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996"} err="failed to get container status \"98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996\": rpc error: code = NotFound desc = could not find container \"98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996\": container with ID starting with 98f38bdef0fe0df0c2c360cdb72c7d273ad3d84c16b0588c9bdb4be3813b8996 not found: ID does not exist"
Jul 17 19:06:35.162287 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.162268    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8459d7946c-lqsmf"]
Jul 17 19:06:35.165456 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.165435    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8459d7946c-lqsmf"]
Jul 17 19:06:35.262356 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:35.262329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:06:36.715776 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:06:36.715738    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe172dd5-0fb7-4c30-82dd-59837f685478" path="/var/lib/kubelet/pods/fe172dd5-0fb7-4c30-82dd-59837f685478/volumes"
Jul 17 19:07:38.466052 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:07:38.466005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:07:38.565578 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:07:38.565540    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:08:02.496779 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:08:02.496739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:08:37.066865 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:08:37.066829    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:08:38.302095 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:08:38.302058    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:16.824845 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:16.824802    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:16.925800 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:16.925762    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:17.048126 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:17.048077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:23.008449 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:23.008398    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:23.064293 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:23.064260    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:23.143259 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:23.143190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:23.233179 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:23.233142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:23.362702 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:23.362664    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:29.530288 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:29.530242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:29.631085 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:29.631046    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:09:48.688078 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:48.688005    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:09:48.690572 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:48.690009    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:09:48.696389 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:48.696364    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:09:48.698222 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:09:48.698203    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:10:18.505018 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:10:18.504983    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:10:33.351111 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:10:33.351069    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:11:24.394116 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:11:24.394083    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:11:24.489073 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:11:24.489025    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:14:48.720939 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:14:48.720812    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:14:48.724317 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:14:48.724286    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:14:48.729800 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:14:48.729772    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:14:48.732545 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:14:48.732525    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:14:59.423202 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:14:59.423162    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:14:59.508629 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:14:59.508564    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:16:22.590736 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:16:22.590641    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:17:00.677881 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:17:00.677835    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:17:50.060694 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:17:50.060654    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:17:50.164664 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:17:50.164627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:19:48.754642 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:19:48.754496    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:19:48.759138 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:19:48.759116    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:19:48.763487 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:19:48.763459    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:19:48.768108 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:19:48.768086    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:20:22.898403 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:22.898307    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:29.469855 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:29.469815    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:37.731094 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:37.731046    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:42.783322 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:42.783275    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:45.725030 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:45.724988    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:45.825820 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:45.825778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:46.152493 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:46.152461    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:52.335129 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:52.335079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:52.398323 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:52.398273    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:52.545338 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:52.545300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:52.637691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:52.637554    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:53.643513 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.643464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:53.714207 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.714172    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"]
Jul 17 19:20:53.714686 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.714672    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe172dd5-0fb7-4c30-82dd-59837f685478" containerName="authorino"
Jul 17 19:20:53.714755 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.714688    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe172dd5-0fb7-4c30-82dd-59837f685478" containerName="authorino"
Jul 17 19:20:53.714796 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.714764    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe172dd5-0fb7-4c30-82dd-59837f685478" containerName="authorino"
Jul 17 19:20:53.716324 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.716294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:53.717529 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.717513    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:53.719934 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.719909    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a4acef77-serving-cert\""
Jul 17 19:20:53.720056 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.719982    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mhzxx\""
Jul 17 19:20:53.724238 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.724213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03126574-4ded-4bc0-98c2-b774a8f8581b-openshift-service-ca\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:53.724352 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.724267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03126574-4ded-4bc0-98c2-b774a8f8581b-maas-api-tls\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:53.724352 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.724325    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfz2s\" (UniqueName: \"kubernetes.io/projected/03126574-4ded-4bc0-98c2-b774a8f8581b-kube-api-access-cfz2s\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:53.729012 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.728974    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"]
Jul 17 19:20:53.785258 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.785217    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:53.825066 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.825012    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03126574-4ded-4bc0-98c2-b774a8f8581b-openshift-service-ca\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:53.825280 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.825095    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03126574-4ded-4bc0-98c2-b774a8f8581b-maas-api-tls\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:53.825280 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.825127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfz2s\" (UniqueName: \"kubernetes.io/projected/03126574-4ded-4bc0-98c2-b774a8f8581b-kube-api-access-cfz2s\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:53.825280 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:20:53.825246    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-serving-cert: secret "maas-api-e2e-ait-a4acef77-serving-cert" not found
Jul 17 19:20:53.825450 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:20:53.825312    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03126574-4ded-4bc0-98c2-b774a8f8581b-maas-api-tls podName:03126574-4ded-4bc0-98c2-b774a8f8581b nodeName:}" failed. No retries permitted until 2026-07-17 19:20:54.325293155 +0000 UTC m=+1566.066045942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03126574-4ded-4bc0-98c2-b774a8f8581b-maas-api-tls") pod "maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4" (UID: "03126574-4ded-4bc0-98c2-b774a8f8581b") : secret "maas-api-e2e-ait-a4acef77-serving-cert" not found
Jul 17 19:20:53.825703 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.825684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03126574-4ded-4bc0-98c2-b774a8f8581b-openshift-service-ca\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:53.836021 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.835993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfz2s\" (UniqueName: \"kubernetes.io/projected/03126574-4ded-4bc0-98c2-b774a8f8581b-kube-api-access-cfz2s\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:53.955596 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:53.955504    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:54.329344 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:54.329311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03126574-4ded-4bc0-98c2-b774a8f8581b-maas-api-tls\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:54.332001 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:54.331975    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03126574-4ded-4bc0-98c2-b774a8f8581b-maas-api-tls\") pod \"maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:54.396236 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:54.396196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:54.496405 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:54.496366    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:20:54.630356 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:54.630252    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:54.789766 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:54.789737    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"]
Jul 17 19:20:54.791342 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:20:54.791310    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03126574_4ded_4bc0_98c2_b774a8f8581b.slice/crio-98c0bff2bd599ad1710b494377301165238f0a363638c9b52ef1b9ea6eb3f8aa WatchSource:0}: Error finding container 98c0bff2bd599ad1710b494377301165238f0a363638c9b52ef1b9ea6eb3f8aa: Status 404 returned error can't find the container with id 98c0bff2bd599ad1710b494377301165238f0a363638c9b52ef1b9ea6eb3f8aa
Jul 17 19:20:54.792799 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:54.792780    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 19:20:55.578810 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:55.578778    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4" event={"ID":"03126574-4ded-4bc0-98c2-b774a8f8581b","Type":"ContainerStarted","Data":"1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3"}
Jul 17 19:20:55.578965 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:55.578831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4" event={"ID":"03126574-4ded-4bc0-98c2-b774a8f8581b","Type":"ContainerStarted","Data":"98c0bff2bd599ad1710b494377301165238f0a363638c9b52ef1b9ea6eb3f8aa"}
Jul 17 19:20:55.578965 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:55.578877    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:20:55.597879 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:55.597823    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4" podStartSLOduration=2.213396 podStartE2EDuration="2.597804677s" totalImagesPullingTime="384.408677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:20:55.595968569 +0000 UTC m=+1567.336721377" watchObservedRunningTime="2026-07-17 19:20:55.597804677 +0000 UTC m=+1567.338557485"
Jul 17 19:20:56.594184 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:20:56.594141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:21:01.589824 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:21:01.589795    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:22:09.219228 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.219192    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"]
Jul 17 19:22:09.219839 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.219418    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4" podUID="03126574-4ded-4bc0-98c2-b774a8f8581b" containerName="maas-api" containerID="cri-o://1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3" gracePeriod=30
Jul 17 19:22:09.254668 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.254634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:09.483792 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.483716    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:22:09.639611 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.639571    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03126574-4ded-4bc0-98c2-b774a8f8581b-openshift-service-ca\") pod \"03126574-4ded-4bc0-98c2-b774a8f8581b\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") "
Jul 17 19:22:09.639803 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.639628    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03126574-4ded-4bc0-98c2-b774a8f8581b-maas-api-tls\") pod \"03126574-4ded-4bc0-98c2-b774a8f8581b\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") "
Jul 17 19:22:09.639803 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.639679    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfz2s\" (UniqueName: \"kubernetes.io/projected/03126574-4ded-4bc0-98c2-b774a8f8581b-kube-api-access-cfz2s\") pod \"03126574-4ded-4bc0-98c2-b774a8f8581b\" (UID: \"03126574-4ded-4bc0-98c2-b774a8f8581b\") "
Jul 17 19:22:09.640032 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.640004    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03126574-4ded-4bc0-98c2-b774a8f8581b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03126574-4ded-4bc0-98c2-b774a8f8581b" (UID: "03126574-4ded-4bc0-98c2-b774a8f8581b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:22:09.642191 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.642155    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03126574-4ded-4bc0-98c2-b774a8f8581b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03126574-4ded-4bc0-98c2-b774a8f8581b" (UID: "03126574-4ded-4bc0-98c2-b774a8f8581b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:22:09.642294 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.642179    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03126574-4ded-4bc0-98c2-b774a8f8581b-kube-api-access-cfz2s" (OuterVolumeSpecName: "kube-api-access-cfz2s") pod "03126574-4ded-4bc0-98c2-b774a8f8581b" (UID: "03126574-4ded-4bc0-98c2-b774a8f8581b"). InnerVolumeSpecName "kube-api-access-cfz2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:22:09.741349 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.741239    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfz2s\" (UniqueName: \"kubernetes.io/projected/03126574-4ded-4bc0-98c2-b774a8f8581b-kube-api-access-cfz2s\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:22:09.741349 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.741286    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03126574-4ded-4bc0-98c2-b774a8f8581b-openshift-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:22:09.741349 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.741295    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03126574-4ded-4bc0-98c2-b774a8f8581b-maas-api-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:22:09.955267 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.955225    2558 generic.go:356] "Generic (PLEG): container finished" podID="03126574-4ded-4bc0-98c2-b774a8f8581b" containerID="1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3" exitCode=0
Jul 17 19:22:09.955267 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.955267    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"
Jul 17 19:22:09.955480 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.955317    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4" event={"ID":"03126574-4ded-4bc0-98c2-b774a8f8581b","Type":"ContainerDied","Data":"1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3"}
Jul 17 19:22:09.955480 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.955368    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4" event={"ID":"03126574-4ded-4bc0-98c2-b774a8f8581b","Type":"ContainerDied","Data":"98c0bff2bd599ad1710b494377301165238f0a363638c9b52ef1b9ea6eb3f8aa"}
Jul 17 19:22:09.955480 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.955395    2558 scope.go:117] "RemoveContainer" containerID="1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3"
Jul 17 19:22:09.964750 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.964732    2558 scope.go:117] "RemoveContainer" containerID="1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3"
Jul 17 19:22:09.965036 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:22:09.965016    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3\": container with ID starting with 1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3 not found: ID does not exist" containerID="1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3"
Jul 17 19:22:09.965099 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.965049    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3"} err="failed to get container status \"1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3\": rpc error: code = NotFound desc = could not find container \"1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3\": container with ID starting with 1d35ff3b7e97bad4a4ed11cd85d50dd92e4c00decfd5b1501ebfdb5b30cebbd3 not found: ID does not exist"
Jul 17 19:22:09.976691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.976657    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"]
Jul 17 19:22:09.980584 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:09.980555    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4acef77-6dfbb69bf4-vl2c4"]
Jul 17 19:22:10.717414 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:10.717378    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03126574-4ded-4bc0-98c2-b774a8f8581b" path="/var/lib/kubelet/pods/03126574-4ded-4bc0-98c2-b774a8f8581b/volumes"
Jul 17 19:22:13.817149 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:13.817114    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:20.128692 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:20.128658    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:20.186131 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:20.186092    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:24.010648 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.010613    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:24.357264 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.357213    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:24.461837 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.461795    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:24.536986 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.536952    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"]
Jul 17 19:22:24.537400 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.537387    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03126574-4ded-4bc0-98c2-b774a8f8581b" containerName="maas-api"
Jul 17 19:22:24.537462 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.537402    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="03126574-4ded-4bc0-98c2-b774a8f8581b" containerName="maas-api"
Jul 17 19:22:24.537498 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.537471    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="03126574-4ded-4bc0-98c2-b774a8f8581b" containerName="maas-api"
Jul 17 19:22:24.540452 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.540428    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.543063 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.543044    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-59b00c87-gw-openshift-default-dockercfg-kfpfm\""
Jul 17 19:22:24.554271 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.554241    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"]
Jul 17 19:22:24.569575 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.569532    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:24.571684 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.571656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-token\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.571854 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.571703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghqk\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-kube-api-access-cghqk\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.571854 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.571780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-socket\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.571854 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.571804    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-certs\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.571854 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.571820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-data\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.571854 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.571836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istiod-ca-cert\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.572144 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.571877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-credential-socket\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.572144 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.571954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-envoy\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.572144 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.571990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-podinfo\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.672571 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.672481    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-token\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.672571 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.672531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghqk\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-kube-api-access-cghqk\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.672856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.672576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-socket\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.672856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.672593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-certs\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.672856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.672641    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-data\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.672856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.672662    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istiod-ca-cert\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.672856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.672695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-credential-socket\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.672856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.672739    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-envoy\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.672856 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.672766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-podinfo\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.673184 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.673089    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-socket\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.673184 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.673161    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-credential-socket\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.673297 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.673249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-certs\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.673346 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.673305    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-data\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.673400 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.673384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istiod-ca-cert\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.675286 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.675262    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-envoy\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.675480 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.675463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-podinfo\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.681999 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.681972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghqk\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-kube-api-access-cghqk\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.682159 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.682140    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-token\") pod \"e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") " pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:24.851535 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:24.851486    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:25.003761 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:25.003730    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"]
Jul 17 19:22:25.005139 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:22:25.005099    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c05c6ec_937c_4b42_93a1_7f292c4d9018.slice/crio-0c3d2cfa8bde2c65195c01e61c040292e689572058a8839c2698efd43de7ddeb WatchSource:0}: Error finding container 0c3d2cfa8bde2c65195c01e61c040292e689572058a8839c2698efd43de7ddeb: Status 404 returned error can't find the container with id 0c3d2cfa8bde2c65195c01e61c040292e689572058a8839c2698efd43de7ddeb
Jul 17 19:22:25.007335 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:25.007299    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:22:25.007410 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:25.007370    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:22:25.007410 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:25.007397    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:22:25.033036 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:25.032996    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" event={"ID":"8c05c6ec-937c-4b42-93a1-7f292c4d9018","Type":"ContainerStarted","Data":"0c3d2cfa8bde2c65195c01e61c040292e689572058a8839c2698efd43de7ddeb"}
Jul 17 19:22:25.779946 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:25.779903    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:25.893155 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:25.893113    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:26.040797 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:26.040704    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" event={"ID":"8c05c6ec-937c-4b42-93a1-7f292c4d9018","Type":"ContainerStarted","Data":"44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1"}
Jul 17 19:22:26.062865 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:26.062810    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" podStartSLOduration=2.062793865 podStartE2EDuration="2.062793865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:22:26.061766008 +0000 UTC m=+1657.802518844" watchObservedRunningTime="2026-07-17 19:22:26.062793865 +0000 UTC m=+1657.803546743"
Jul 17 19:22:26.201170 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:26.201131    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:26.413917 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:26.413877    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:26.513710 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:26.513669    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:26.851959 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:26.851920    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:26.857421 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:26.857391    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:27.045770 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:27.045734    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:27.046790 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:27.046767    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:37.474618 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:37.474550    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:37.551459 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:37.551420    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:40.990771 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:40.990736    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:22:41.118208 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:41.118175    2558 generic.go:356] "Generic (PLEG): container finished" podID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerID="44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1" exitCode=0
Jul 17 19:22:41.118385 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:41.118240    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" event={"ID":"8c05c6ec-937c-4b42-93a1-7f292c4d9018","Type":"ContainerDied","Data":"44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1"}
Jul 17 19:22:41.118662 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:41.118646    2558 scope.go:117] "RemoveContainer" containerID="44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1"
Jul 17 19:22:41.119785 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:41.119750    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:22:41.119904 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:41.119841    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:22:41.119968 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:41.119913    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:22:42.046246 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:42.046203    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:42.125324 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:42.125291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" event={"ID":"8c05c6ec-937c-4b42-93a1-7f292c4d9018","Type":"ContainerStarted","Data":"6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655"}
Jul 17 19:22:42.853003 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:42.852962    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:42.853864 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:42.853836    2558 patch_prober.go:28] interesting pod/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 19:22:42.854100 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:42.854073    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 19:22:43.853001 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:43.852957    2558 patch_prober.go:28] interesting pod/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 19:22:43.853675 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:43.853634    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 19:22:44.852343 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:44.852295    2558 patch_prober.go:28] interesting pod/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 19:22:44.852563 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:44.852370    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 19:22:45.852628 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:45.852560    2558 patch_prober.go:28] interesting pod/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 19:22:45.853172 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:45.852657    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 19:22:46.856848 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:46.856820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:46.857247 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:46.857149    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:22:46.857833 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:22:46.857816    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:23:04.774527 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:04.774492    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:30.403397 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:30.403362    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"]
Jul 17 19:23:30.403970 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:30.403624    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy" containerID="cri-o://6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655" gracePeriod=30
Jul 17 19:23:30.424942 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:30.424899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:30.530990 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:30.530955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:30.773657 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:30.773533    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:31.859666 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:31.859589    2558 patch_prober.go:28] interesting pod/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 19:23:31.860053 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:31.859687    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 19:23:35.675371 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.675298    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:23:35.773974 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.773832    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-envoy\") pod \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") "
Jul 17 19:23:35.773974 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.773885    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-socket\") pod \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") "
Jul 17 19:23:35.773974 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.773911    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-token\") pod \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") "
Jul 17 19:23:35.773974 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.773972    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-data\") pod \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") "
Jul 17 19:23:35.774232 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.774019    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-podinfo\") pod \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") "
Jul 17 19:23:35.774232 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.774048    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istiod-ca-cert\") pod \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") "
Jul 17 19:23:35.774232 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.774102    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cghqk\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-kube-api-access-cghqk\") pod \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") "
Jul 17 19:23:35.774232 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.774166    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-credential-socket\") pod \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") "
Jul 17 19:23:35.774232 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.774203    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-certs\") pod \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\" (UID: \"8c05c6ec-937c-4b42-93a1-7f292c4d9018\") "
Jul 17 19:23:35.774232 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.774217    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c05c6ec-937c-4b42-93a1-7f292c4d9018" (UID: "8c05c6ec-937c-4b42-93a1-7f292c4d9018"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:35.774632 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.774582    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-socket\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:23:35.774771 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.774628    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c05c6ec-937c-4b42-93a1-7f292c4d9018" (UID: "8c05c6ec-937c-4b42-93a1-7f292c4d9018"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:35.774771 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.774681    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c05c6ec-937c-4b42-93a1-7f292c4d9018" (UID: "8c05c6ec-937c-4b42-93a1-7f292c4d9018"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:23:35.775247 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.775219    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c05c6ec-937c-4b42-93a1-7f292c4d9018" (UID: "8c05c6ec-937c-4b42-93a1-7f292c4d9018"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:35.775529 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.775497    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c05c6ec-937c-4b42-93a1-7f292c4d9018" (UID: "8c05c6ec-937c-4b42-93a1-7f292c4d9018"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:35.777028 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.776996    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c05c6ec-937c-4b42-93a1-7f292c4d9018" (UID: "8c05c6ec-937c-4b42-93a1-7f292c4d9018"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:35.777332 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.777300    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c05c6ec-937c-4b42-93a1-7f292c4d9018" (UID: "8c05c6ec-937c-4b42-93a1-7f292c4d9018"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:23:35.777428 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.777357    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-kube-api-access-cghqk" (OuterVolumeSpecName: "kube-api-access-cghqk") pod "8c05c6ec-937c-4b42-93a1-7f292c4d9018" (UID: "8c05c6ec-937c-4b42-93a1-7f292c4d9018"). InnerVolumeSpecName "kube-api-access-cghqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:23:35.777428 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.777385    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c05c6ec-937c-4b42-93a1-7f292c4d9018" (UID: "8c05c6ec-937c-4b42-93a1-7f292c4d9018"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:23:35.875395 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.875362    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-credential-socket\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:23:35.875395 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.875392    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-workload-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:23:35.875395 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.875401    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-envoy\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:23:35.875691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.875410    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-token\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:23:35.875691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.875418    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-data\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:23:35.875691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.875426    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istio-podinfo\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:23:35.875691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.875433    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c05c6ec-937c-4b42-93a1-7f292c4d9018-istiod-ca-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:23:35.875691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:35.875442    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cghqk\" (UniqueName: \"kubernetes.io/projected/8c05c6ec-937c-4b42-93a1-7f292c4d9018-kube-api-access-cghqk\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:23:36.396816 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.396779    2558 generic.go:356] "Generic (PLEG): container finished" podID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerID="6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655" exitCode=0
Jul 17 19:23:36.397006 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.396832    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"
Jul 17 19:23:36.397006 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.396856    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" event={"ID":"8c05c6ec-937c-4b42-93a1-7f292c4d9018","Type":"ContainerDied","Data":"6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655"}
Jul 17 19:23:36.397006 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.396914    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg" event={"ID":"8c05c6ec-937c-4b42-93a1-7f292c4d9018","Type":"ContainerDied","Data":"0c3d2cfa8bde2c65195c01e61c040292e689572058a8839c2698efd43de7ddeb"}
Jul 17 19:23:36.397006 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.396938    2558 scope.go:117] "RemoveContainer" containerID="6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655"
Jul 17 19:23:36.406712 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.406693    2558 scope.go:117] "RemoveContainer" containerID="44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1"
Jul 17 19:23:36.415554 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.415531    2558 scope.go:117] "RemoveContainer" containerID="6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655"
Jul 17 19:23:36.415960 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:23:36.415919    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655\": container with ID starting with 6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655 not found: ID does not exist" containerID="6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655"
Jul 17 19:23:36.416065 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.415961    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655"} err="failed to get container status \"6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655\": rpc error: code = NotFound desc = could not find container \"6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655\": container with ID starting with 6d4c56cd50a55ed29cb104f6a135b9b3d24dc9365a76d9489c7cdca4f3535655 not found: ID does not exist"
Jul 17 19:23:36.416065 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.415987    2558 scope.go:117] "RemoveContainer" containerID="44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1"
Jul 17 19:23:36.416357 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:23:36.416319    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1\": container with ID starting with 44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1 not found: ID does not exist" containerID="44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1"
Jul 17 19:23:36.416441 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.416354    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1"} err="failed to get container status \"44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1\": rpc error: code = NotFound desc = could not find container \"44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1\": container with ID starting with 44777ea76dc226e4a297f9e7b90429ea58dd18a4e6b4cac0f71c0eaf6bce6cb1 not found: ID does not exist"
Jul 17 19:23:36.418323 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.418301    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"]
Jul 17 19:23:36.422148 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.422117    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-59b00c87-gw-openshift-default-76bd965b87-r5jcg"]
Jul 17 19:23:36.653211 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.653106    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:36.717059 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.717028    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" path="/var/lib/kubelet/pods/8c05c6ec-937c-4b42-93a1-7f292c4d9018/volumes"
Jul 17 19:23:36.753222 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.753185    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:36.839463 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.839428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:36.908262 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:36.908166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:37.984562 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:37.984524    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:38.068313 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:38.068211    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:38.131179 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:38.131151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:38.357342 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:38.357306    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:38.760283 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:38.760182    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:38.863819 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:38.863779    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:40.145203 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:40.145171    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:23:59.969838 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:23:59.969790    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:00.072731 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:00.072688    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:00.827880 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:00.827839    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:00.928041 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:00.928005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:43.856297 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:43.856164    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:48.200028 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:48.199989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:48.785891 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:48.785855    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:24:48.791498 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:48.791469    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:24:48.793503 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:48.793478    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:24:48.799038 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:48.799015    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:24:53.602060 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:53.602015    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:54.193553 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:54.193513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:54.294967 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:54.294931    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:59.196065 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.196018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:59.480518 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.480423    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"]
Jul 17 19:24:59.480910 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.480895    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy"
Jul 17 19:24:59.480979 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.480911    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy"
Jul 17 19:24:59.480979 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.480930    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy"
Jul 17 19:24:59.480979 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.480935    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy"
Jul 17 19:24:59.481145 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.481006    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy"
Jul 17 19:24:59.481145 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.481014    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c05c6ec-937c-4b42-93a1-7f292c4d9018" containerName="istio-proxy"
Jul 17 19:24:59.484235 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.484202    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.487152 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.487123    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3c4aca95-openshift-default-dockercfg-ff87s\""
Jul 17 19:24:59.498073 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.498043    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"]
Jul 17 19:24:59.517790 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.517748    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:24:59.569085 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.569045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-envoy\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.569267 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.569096    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-credential-socket\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.569267 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.569118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhfgs\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-kube-api-access-vhfgs\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.569267 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.569170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-socket\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.569379 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.569262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-podinfo\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.569379 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.569289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-token\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.569379 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.569319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-data\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.569379 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.569335    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-certs\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.569514 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.569401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83c052b5-d032-4fb6-bab7-13335e4709d4-istiod-ca-cert\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.670536 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-data\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.670536 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-certs\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.670847 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83c052b5-d032-4fb6-bab7-13335e4709d4-istiod-ca-cert\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.670847 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-envoy\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.670847 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-credential-socket\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.670847 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670722    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhfgs\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-kube-api-access-vhfgs\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.670847 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-socket\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.670847 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-podinfo\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.671176 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-token\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.671176 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.670934    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-data\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.671360 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.671336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83c052b5-d032-4fb6-bab7-13335e4709d4-istiod-ca-cert\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.671515 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.671493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-socket\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.671780 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.671525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-credential-socket\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.671780 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.671549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-certs\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.673481 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.673458    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-envoy\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.673637 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.673618    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-podinfo\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.679094 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.679050    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-token\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.679206 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.679129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhfgs\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-kube-api-access-vhfgs\") pod \"e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") " pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.797504 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.797407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:24:59.952402 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.952372    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"]
Jul 17 19:24:59.954653 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:24:59.954623    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c052b5_d032_4fb6_bab7_13335e4709d4.slice/crio-96fe5e6c07ff694edb2d657648eb275831e38a762a50b1c4b07ed90a1ea36fde WatchSource:0}: Error finding container 96fe5e6c07ff694edb2d657648eb275831e38a762a50b1c4b07ed90a1ea36fde: Status 404 returned error can't find the container with id 96fe5e6c07ff694edb2d657648eb275831e38a762a50b1c4b07ed90a1ea36fde
Jul 17 19:24:59.957306 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.957267    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:24:59.957384 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.957342    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:24:59.957434 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:24:59.957395    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:25:00.622038 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:00.621993    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:00.706369 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:00.706315    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:00.785053 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:00.785013    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:00.826245 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:00.826208    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" event={"ID":"83c052b5-d032-4fb6-bab7-13335e4709d4","Type":"ContainerStarted","Data":"57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736"}
Jul 17 19:25:00.826464 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:00.826277    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" event={"ID":"83c052b5-d032-4fb6-bab7-13335e4709d4","Type":"ContainerStarted","Data":"96fe5e6c07ff694edb2d657648eb275831e38a762a50b1c4b07ed90a1ea36fde"}
Jul 17 19:25:00.855709 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:00.855650    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" podStartSLOduration=1.8556310809999998 podStartE2EDuration="1.855631081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:25:00.853643701 +0000 UTC m=+1812.594396500" watchObservedRunningTime="2026-07-17 19:25:00.855631081 +0000 UTC m=+1812.596383890"
Jul 17 19:25:01.135739 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:01.135704    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:01.285442 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:01.285403    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:01.385936 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:01.385833    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:01.797956 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:01.797858    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:25:01.803077 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:01.803037    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:25:01.831540 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:01.831514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:25:01.832582 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:01.832564    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:25:05.735227 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:05.735193    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:05.835618 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:05.835572    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:09.090131 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:09.090077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:11.898098 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:11.898061    2558 generic.go:356] "Generic (PLEG): container finished" podID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerID="57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736" exitCode=0
Jul 17 19:25:11.898551 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:11.898138    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" event={"ID":"83c052b5-d032-4fb6-bab7-13335e4709d4","Type":"ContainerDied","Data":"57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736"}
Jul 17 19:25:11.898594 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:11.898566    2558 scope.go:117] "RemoveContainer" containerID="57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736"
Jul 17 19:25:11.899770 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:11.899738    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:25:11.899835 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:11.899813    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:25:11.899872 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:11.899844    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:25:12.904534 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:12.904501    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" event={"ID":"83c052b5-d032-4fb6-bab7-13335e4709d4","Type":"ContainerStarted","Data":"cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98"}
Jul 17 19:25:13.797612 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:13.797569    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:25:13.798749 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:13.798722    2558 patch_prober.go:28] interesting pod/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 19:25:13.798904 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:13.798780    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 19:25:14.798312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:14.798271    2558 patch_prober.go:28] interesting pod/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 19:25:14.798822 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:14.798334    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 19:25:15.798559 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:15.798520    2558 patch_prober.go:28] interesting pod/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 19:25:15.799094 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:15.798578    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 19:25:16.802068 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:16.802030    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:25:16.802563 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:16.802316    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:25:16.803100 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:16.803083    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:25:35.794842 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:35.794803    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:54.305700 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:54.305652    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:25:54.365833 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:25:54.365792    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:05.538799 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:05.538756    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:10.172461 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:10.172347    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:16.442035 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:16.441999    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:16.499568 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:16.499521    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:20.398097 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:20.398062    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"]
Jul 17 19:26:20.398634 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:20.398251    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy" containerID="cri-o://cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98" gracePeriod=30
Jul 17 19:26:20.419894 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:20.419859    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:20.964870 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:20.964832    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:21.068691 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:21.068650    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:21.177126 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:21.177085    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:22.686912 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:22.686875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:25.668664 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.668572    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:26:25.796109 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796066    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-podinfo\") pod \"83c052b5-d032-4fb6-bab7-13335e4709d4\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") "
Jul 17 19:26:25.796319 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796134    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhfgs\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-kube-api-access-vhfgs\") pod \"83c052b5-d032-4fb6-bab7-13335e4709d4\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") "
Jul 17 19:26:25.796319 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-envoy\") pod \"83c052b5-d032-4fb6-bab7-13335e4709d4\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") "
Jul 17 19:26:25.796319 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796231    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-certs\") pod \"83c052b5-d032-4fb6-bab7-13335e4709d4\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") "
Jul 17 19:26:25.796319 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796251    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-socket\") pod \"83c052b5-d032-4fb6-bab7-13335e4709d4\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") "
Jul 17 19:26:25.796319 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796269    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-data\") pod \"83c052b5-d032-4fb6-bab7-13335e4709d4\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") "
Jul 17 19:26:25.796319 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796305    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-credential-socket\") pod \"83c052b5-d032-4fb6-bab7-13335e4709d4\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") "
Jul 17 19:26:25.796319 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796320    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-token\") pod \"83c052b5-d032-4fb6-bab7-13335e4709d4\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") "
Jul 17 19:26:25.796749 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796356    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83c052b5-d032-4fb6-bab7-13335e4709d4-istiod-ca-cert\") pod \"83c052b5-d032-4fb6-bab7-13335e4709d4\" (UID: \"83c052b5-d032-4fb6-bab7-13335e4709d4\") "
Jul 17 19:26:25.796749 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796517    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83c052b5-d032-4fb6-bab7-13335e4709d4" (UID: "83c052b5-d032-4fb6-bab7-13335e4709d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:26:25.796857 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796762    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:26:25.796857 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796762    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83c052b5-d032-4fb6-bab7-13335e4709d4" (UID: "83c052b5-d032-4fb6-bab7-13335e4709d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:26:25.796857 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796830    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83c052b5-d032-4fb6-bab7-13335e4709d4" (UID: "83c052b5-d032-4fb6-bab7-13335e4709d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:26:25.796857 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.796844    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83c052b5-d032-4fb6-bab7-13335e4709d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83c052b5-d032-4fb6-bab7-13335e4709d4" (UID: "83c052b5-d032-4fb6-bab7-13335e4709d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:26:25.797340 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.797308    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "83c052b5-d032-4fb6-bab7-13335e4709d4" (UID: "83c052b5-d032-4fb6-bab7-13335e4709d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:26:25.798774 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.798743    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83c052b5-d032-4fb6-bab7-13335e4709d4" (UID: "83c052b5-d032-4fb6-bab7-13335e4709d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:26:25.798908 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.798743    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83c052b5-d032-4fb6-bab7-13335e4709d4" (UID: "83c052b5-d032-4fb6-bab7-13335e4709d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:26:25.798908 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.798831    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-kube-api-access-vhfgs" (OuterVolumeSpecName: "kube-api-access-vhfgs") pod "83c052b5-d032-4fb6-bab7-13335e4709d4" (UID: "83c052b5-d032-4fb6-bab7-13335e4709d4"). InnerVolumeSpecName "kube-api-access-vhfgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:26:25.799122 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.799102    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "83c052b5-d032-4fb6-bab7-13335e4709d4" (UID: "83c052b5-d032-4fb6-bab7-13335e4709d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:26:25.898124 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.898089    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhfgs\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-kube-api-access-vhfgs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:26:25.898124 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.898120    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-envoy\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:26:25.898124 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.898130    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-workload-socket\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:26:25.898124 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.898139    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-data\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:26:25.898410 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.898148    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83c052b5-d032-4fb6-bab7-13335e4709d4-credential-socket\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:26:25.898410 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.898156    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-token\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:26:25.898410 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.898165    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83c052b5-d032-4fb6-bab7-13335e4709d4-istiod-ca-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:26:25.898410 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:25.898172    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83c052b5-d032-4fb6-bab7-13335e4709d4-istio-podinfo\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:26:26.291559 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.291522    2558 generic.go:356] "Generic (PLEG): container finished" podID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerID="cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98" exitCode=0
Jul 17 19:26:26.291772 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.291575    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"
Jul 17 19:26:26.291772 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.291627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" event={"ID":"83c052b5-d032-4fb6-bab7-13335e4709d4","Type":"ContainerDied","Data":"cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98"}
Jul 17 19:26:26.291772 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.291685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j" event={"ID":"83c052b5-d032-4fb6-bab7-13335e4709d4","Type":"ContainerDied","Data":"96fe5e6c07ff694edb2d657648eb275831e38a762a50b1c4b07ed90a1ea36fde"}
Jul 17 19:26:26.291772 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.291717    2558 scope.go:117] "RemoveContainer" containerID="cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98"
Jul 17 19:26:26.306730 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.306703    2558 scope.go:117] "RemoveContainer" containerID="57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736"
Jul 17 19:26:26.315721 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.315698    2558 scope.go:117] "RemoveContainer" containerID="cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98"
Jul 17 19:26:26.315986 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:26:26.315965    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98\": container with ID starting with cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98 not found: ID does not exist" containerID="cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98"
Jul 17 19:26:26.316035 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.315997    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98"} err="failed to get container status \"cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98\": rpc error: code = NotFound desc = could not find container \"cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98\": container with ID starting with cdaad6c08f8b426a7d1d995c56a2a8a34fdfbdf12df145fd2bb4b1ff4cde8b98 not found: ID does not exist"
Jul 17 19:26:26.316035 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.316020    2558 scope.go:117] "RemoveContainer" containerID="57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736"
Jul 17 19:26:26.316221 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:26:26.316199    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736\": container with ID starting with 57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736 not found: ID does not exist" containerID="57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736"
Jul 17 19:26:26.316260 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.316229    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736"} err="failed to get container status \"57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736\": rpc error: code = NotFound desc = could not find container \"57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736\": container with ID starting with 57e4a895d1235d71b9dcbcaeaa5d534c3356bacd9656e6da9b90a38405ab1736 not found: ID does not exist"
Jul 17 19:26:26.326411 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.326381    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"]
Jul 17 19:26:26.331086 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.331062    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3c4aca95-openshift-default-8569c658f5-8lr4j"]
Jul 17 19:26:26.716699 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.716656    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" path="/var/lib/kubelet/pods/83c052b5-d032-4fb6-bab7-13335e4709d4/volumes"
Jul 17 19:26:26.875385 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:26.875333    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:29.542792 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:29.542750    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:29.609325 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:29.609288    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:29.683334 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:29.683300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:29.781670 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:29.781633    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:29.882752 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:29.882712    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:30.262065 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:30.261978    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:26:56.203356 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:26:56.203312    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:02.307427 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:02.307379    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:02.371405 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:02.371367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:02.436555 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:02.436516    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:02.535236 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:02.535184    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:18.391492 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:18.391454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:24.589166 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:24.589126    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:24.693282 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:24.693245    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:24.789492 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:24.789459    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:35.323572 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:35.323530    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:36.111120 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:36.111073    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:42.089825 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:42.089739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:42.148268 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:42.148225    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:42.222770 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:42.222734    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:42.323533 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:42.323493    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:42.425441 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:42.425341    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:43.106501 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:43.106457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:43.205563 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:43.205527    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:43.305207 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:43.305161    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:44.838945 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:44.838908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:50.977462 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:50.977407    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:51.077954 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:51.077918    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:51.621535 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:51.621499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:57.641191 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:57.641142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:57.699824 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:57.699770    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:57.879881 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:57.879846    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:58.186450 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:58.186414    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:27:58.433616 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:27:58.433546    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:01.244240 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:01.244194    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:01.350385 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:01.350337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:01.511945 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:01.511834    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:01.747427 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:01.747392    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:01.996721 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:01.996686    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:02.097103 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:02.097066    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:05.725805 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:05.725761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:06.384909 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:06.384867    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:06.483133 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:06.483092    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:06.854229 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:06.854200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:12.634590 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:12.634551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:12.735446 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:12.735402    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:23.436798 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:23.436723    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:28.088001 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:28.087961    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:34.362168 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:34.362129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:34.446322 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:34.446285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:38.776851 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:38.776810    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:39.001039 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:39.000996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:39.117125 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:39.117087    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:39.217184 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:39.217148    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:39.329337 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:39.329299    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:45.525051 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:45.525005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:45.589329 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:45.589287    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:45.686879 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:45.686843    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:45.790719 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:45.790621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:45.883541 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:45.883506    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:51.727311 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:51.727268    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:51.827057 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:51.827024    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:58.568925 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:58.568882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:58.869110 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:58.869079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:28:59.119546 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:28:59.119460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:00.817003 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:00.816964    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:00.917585 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:00.917547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:01.535988 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:01.535953    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:01.624055 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:01.624005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:01.689922 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:01.689886    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:01.798875 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:01.798781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:02.225613 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:02.225566    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:02.326371 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:02.326318    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:06.025227 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:06.025189    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:14.439299 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:14.439212    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:44.522126 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:44.522082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:48.815922 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:48.815888    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:29:48.823421 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:48.823392    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:29:48.824357 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:48.824337    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:29:48.831304 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:48.831280    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:29:49.118940 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:49.118902    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:29:54.146094 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:29:54.146056    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:30.709568 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:30.709528    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:31.343398 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:31.343355    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:37.122375 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:37.122335    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:37.222293 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:37.222246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:39.674236 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:39.674200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:41.262589 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:41.262499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:41.447945 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:41.447908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:42.463454 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:42.463411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:42.556994 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:42.556957    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:42.656984 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:42.656937    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:43.312773 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:43.312731    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:43.412822 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:43.412775    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:43.513010 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:43.512978    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:44.848340 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:44.848287    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:50.842637 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:50.842575    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:50.899978 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:50.899943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:51.512752 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:51.512707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:54.336791 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:54.336755    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:54.399566 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:54.399530    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:57.373335 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:57.373300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:57.478218 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:57.478175    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:30:57.572892 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:30:57.572846    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:08.071494 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:08.071452    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:08.408208 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:08.408173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:29.322568 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:29.322531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:35.467358 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:35.467319    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:35.568086 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:35.568049    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:35.792573 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:35.792475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:36.101738 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:36.101701    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:36.284594 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:36.284560    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:39.377829 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:39.377789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:39.477200 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:39.477162    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:39.615040 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:39.615004    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:39.830212 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:39.830182    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:40.062909 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:40.062871    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:40.164521 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:40.164435    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:43.858734 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:43.858681    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:44.180765 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:44.180673    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:44.484161 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:44.484059    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:44.605455 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:44.605414    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:47.406210 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:47.406164    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:47.501974 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:47.501936    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:47.701696 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:47.701578    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:48.015359 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:48.015252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:48.143898 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:48.143862    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:48.244776 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:48.244733    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:31:51.893948 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:31:51.893906    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:00.964019 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:00.963948    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:01.107389 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:01.107349    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:07.126358 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:07.126320    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:08.964705 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:08.964667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:09.065588 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:09.065548    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:21.113934 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:21.113836    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:40.015776 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:40.015732    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:40.952443 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:40.952398    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:41.598448 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:41.598412    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:41.698271 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:41.698234    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:51.596792 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:51.596759    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:32:56.143049 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:32:56.143009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:02.110117 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:02.110078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:02.211401 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:02.211363    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:06.821560 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:06.821506    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:07.041952 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:07.041911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:07.844454 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:07.844419    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:07.946924 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:07.946862    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:17.729349 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:17.729317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:22.256343 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:22.256302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:28.354404 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:28.354367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:28.453352 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:28.453315    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:32.933631 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:32.933561    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:33.151111 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:33.151071    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:33.486360 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:33.486322    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:33.783123 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:33.783021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:33.916825 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:33.916783    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:37.018891 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:37.018848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:37.098292 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:37.098254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:37.165728 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:37.165674    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:37.387201 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:37.387143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:37.593381 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:37.593344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:37.694962 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:37.694862    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:41.491207 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:41.491104    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:41.942247 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:41.942208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:42.220992 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.220907    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"]
Jul 17 19:33:42.221595 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.221559    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy"
Jul 17 19:33:42.221595 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.221587    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy"
Jul 17 19:33:42.221837 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.221621    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy"
Jul 17 19:33:42.221837 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.221629    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy"
Jul 17 19:33:42.221837 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.221717    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy"
Jul 17 19:33:42.225204 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.225183    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.227467 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.227446    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b6c908-openshift-default-dockercfg-ds95b\""
Jul 17 19:33:42.235640 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.235588    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"]
Jul 17 19:33:42.248570 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.248523    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:42.381149 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.381113    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:42.393659 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.393625    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-socket\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.393811 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.393668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2629fd6-ed88-45d2-aa2e-280718608121-istiod-ca-cert\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.393811 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.393707    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-credential-socket\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.393811 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.393723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9b75\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-kube-api-access-s9b75\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.393811 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.393753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-istio-token\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.393811 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.393808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-envoy\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.394004 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.393838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-certs\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.394004 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.393862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2629fd6-ed88-45d2-aa2e-280718608121-istio-podinfo\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.394004 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.393913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-data\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.494774 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.494670    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-data\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.494774 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.494744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-socket\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.494781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2629fd6-ed88-45d2-aa2e-280718608121-istiod-ca-cert\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.494837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-credential-socket\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.494861    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9b75\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-kube-api-access-s9b75\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.494891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-istio-token\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.494955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-envoy\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.494986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-certs\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.495108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-data\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.495141    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-credential-socket\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495312 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.495212    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2629fd6-ed88-45d2-aa2e-280718608121-istio-podinfo\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495828 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.495358    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-certs\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495828 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.495397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-socket\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.495828 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.495572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2629fd6-ed88-45d2-aa2e-280718608121-istiod-ca-cert\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.497529 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.497507    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-envoy\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.497791 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.497772    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2629fd6-ed88-45d2-aa2e-280718608121-istio-podinfo\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.502623 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.502585    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-istio-token\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.502750 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.502684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9b75\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-kube-api-access-s9b75\") pod \"e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") " pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.536819 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.536777    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:42.690582 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.690552    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"]
Jul 17 19:33:42.691367 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:33:42.691338    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2629fd6_ed88_45d2_aa2e_280718608121.slice/crio-bda990033c1fa42982e2a909ed418acdae6bff5c9e1f8ca5adfd880aa2c20190 WatchSource:0}: Error finding container bda990033c1fa42982e2a909ed418acdae6bff5c9e1f8ca5adfd880aa2c20190: Status 404 returned error can't find the container with id bda990033c1fa42982e2a909ed418acdae6bff5c9e1f8ca5adfd880aa2c20190
Jul 17 19:33:42.695071 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.693981    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:33:42.695071 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.694148    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:33:42.695071 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:42.694234    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:33:43.497794 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:43.497756    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" event={"ID":"f2629fd6-ed88-45d2-aa2e-280718608121","Type":"ContainerStarted","Data":"c907e9cc14f53ed9ef33ddd69b64660d91e220bdada541deb652e7c99d73c7d5"}
Jul 17 19:33:43.498214 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:43.497827    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" event={"ID":"f2629fd6-ed88-45d2-aa2e-280718608121","Type":"ContainerStarted","Data":"bda990033c1fa42982e2a909ed418acdae6bff5c9e1f8ca5adfd880aa2c20190"}
Jul 17 19:33:43.522142 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:43.522085    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" podStartSLOduration=1.522069838 podStartE2EDuration="1.522069838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:33:43.519751846 +0000 UTC m=+2335.260504656" watchObservedRunningTime="2026-07-17 19:33:43.522069838 +0000 UTC m=+2335.262822646"
Jul 17 19:33:43.537853 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:43.537811    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:43.539167 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:43.539141    2558 patch_prober.go:28] interesting pod/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 19:33:43.539235 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:43.539204    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 19:33:44.542047 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:44.542012    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:45.434087 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:45.434049    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:45.507555 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:45.507525    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:45.508734 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:45.508714    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:33:45.532727 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:45.532689    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:45.673195 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:45.673160    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:45.832864 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:45.832830    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:46.230478 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:46.230377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:46.332267 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:46.332224    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:49.921019 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:49.920973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:58.402243 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:58.402204    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:33:58.502246 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:33:58.502203    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:01.559186 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:01.559146    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:01.659911 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:01.659873    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:05.613417 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:05.613382    2558 generic.go:356] "Generic (PLEG): container finished" podID="f2629fd6-ed88-45d2-aa2e-280718608121" containerID="c907e9cc14f53ed9ef33ddd69b64660d91e220bdada541deb652e7c99d73c7d5" exitCode=0
Jul 17 19:34:05.614073 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:05.613464    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" event={"ID":"f2629fd6-ed88-45d2-aa2e-280718608121","Type":"ContainerDied","Data":"c907e9cc14f53ed9ef33ddd69b64660d91e220bdada541deb652e7c99d73c7d5"}
Jul 17 19:34:05.614073 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:05.614057    2558 scope.go:117] "RemoveContainer" containerID="c907e9cc14f53ed9ef33ddd69b64660d91e220bdada541deb652e7c99d73c7d5"
Jul 17 19:34:05.615226 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:05.615193    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:34:05.615302 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:05.615284    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:34:05.615375 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:05.615356    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 19:34:06.620780 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:06.620744    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" event={"ID":"f2629fd6-ed88-45d2-aa2e-280718608121","Type":"ContainerStarted","Data":"4ecae59c5d1be3a8101350e755a441b9feadfe3d5434ae2f6a10cfa8c6fbb119"}
Jul 17 19:34:07.230746 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:07.230699    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:07.331500 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:07.331452    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:07.537678 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:07.537546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:34:07.537848 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:07.537761    2558 patch_prober.go:28] interesting pod/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 19:34:07.537848 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:07.537812    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 19:34:08.446013 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:08.445910    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:08.537445 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:08.537404    2558 patch_prober.go:28] interesting pod/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 19:34:08.537658 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:08.537462    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 19:34:08.546199 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:08.546155    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:08.701198 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:08.701075    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:09.537929 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:09.537891    2558 patch_prober.go:28] interesting pod/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 19:34:09.538340 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:09.537948    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 19:34:10.537931 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:10.537894    2558 patch_prober.go:28] interesting pod/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 19:34:10.538118 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:10.537952    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 19:34:11.541721 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:11.541690    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:34:11.542185 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:11.541980    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:34:11.542631 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:11.542597    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:34:13.001447 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:13.001406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:18.911725 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:18.911672    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:18.984099 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:18.984065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:23.647817 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:23.647758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:23.863742 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:23.863702    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:24.552567 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:24.552528    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:24.655258 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:24.655216    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:34.527870 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:34.527827    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:39.092033 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:39.091994    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:44.976695 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:44.976624    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:45.087366 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:45.087325    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:48.855123 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:48.855089    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:34:48.861814 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:48.861783    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:34:48.862795 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:48.862768    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:34:48.869701 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:48.869680    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:34:49.754374 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:49.754336    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"]
Jul 17 19:34:49.754723 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:49.754664    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy" containerID="cri-o://4ecae59c5d1be3a8101350e755a441b9feadfe3d5434ae2f6a10cfa8c6fbb119" gracePeriod=30
Jul 17 19:34:49.773492 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:49.773454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:49.995285 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:49.995233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:50.335787 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:50.335732    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:50.638217 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:50.638126    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:50.760640 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:50.760594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:53.410537 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:53.410495    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:53.489940 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:53.489908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:53.562419 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:53.562387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:53.660494 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:53.660459    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:53.975938 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:53.975896    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:54.075770 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:54.075725    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:54.894622 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:54.894572    2558 generic.go:356] "Generic (PLEG): container finished" podID="f2629fd6-ed88-45d2-aa2e-280718608121" containerID="4ecae59c5d1be3a8101350e755a441b9feadfe3d5434ae2f6a10cfa8c6fbb119" exitCode=0
Jul 17 19:34:54.895089 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:54.894697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" event={"ID":"f2629fd6-ed88-45d2-aa2e-280718608121","Type":"ContainerDied","Data":"4ecae59c5d1be3a8101350e755a441b9feadfe3d5434ae2f6a10cfa8c6fbb119"}
Jul 17 19:34:54.895089 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:54.894779    2558 scope.go:117] "RemoveContainer" containerID="c907e9cc14f53ed9ef33ddd69b64660d91e220bdada541deb652e7c99d73c7d5"
Jul 17 19:34:55.028814 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.028736    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:34:55.094998 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.094965    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2629fd6-ed88-45d2-aa2e-280718608121-istio-podinfo\") pod \"f2629fd6-ed88-45d2-aa2e-280718608121\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") "
Jul 17 19:34:55.095202 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095028    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-data\") pod \"f2629fd6-ed88-45d2-aa2e-280718608121\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") "
Jul 17 19:34:55.095202 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095054    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-socket\") pod \"f2629fd6-ed88-45d2-aa2e-280718608121\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") "
Jul 17 19:34:55.095202 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095078    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9b75\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-kube-api-access-s9b75\") pod \"f2629fd6-ed88-45d2-aa2e-280718608121\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") "
Jul 17 19:34:55.095202 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095186    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-istio-token\") pod \"f2629fd6-ed88-45d2-aa2e-280718608121\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") "
Jul 17 19:34:55.095421 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095221    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-credential-socket\") pod \"f2629fd6-ed88-45d2-aa2e-280718608121\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") "
Jul 17 19:34:55.095421 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095261    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-envoy\") pod \"f2629fd6-ed88-45d2-aa2e-280718608121\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") "
Jul 17 19:34:55.095421 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095283    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-certs\") pod \"f2629fd6-ed88-45d2-aa2e-280718608121\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") "
Jul 17 19:34:55.095421 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095325    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2629fd6-ed88-45d2-aa2e-280718608121-istiod-ca-cert\") pod \"f2629fd6-ed88-45d2-aa2e-280718608121\" (UID: \"f2629fd6-ed88-45d2-aa2e-280718608121\") "
Jul 17 19:34:55.095421 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095349    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2629fd6-ed88-45d2-aa2e-280718608121" (UID: "f2629fd6-ed88-45d2-aa2e-280718608121"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:34:55.095754 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095545    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2629fd6-ed88-45d2-aa2e-280718608121" (UID: "f2629fd6-ed88-45d2-aa2e-280718608121"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:34:55.095754 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095582    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2629fd6-ed88-45d2-aa2e-280718608121" (UID: "f2629fd6-ed88-45d2-aa2e-280718608121"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:34:55.095754 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095726    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-socket\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:34:55.095754 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095746    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-credential-socket\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:34:55.096060 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095761    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-workload-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:34:55.096060 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.095900    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2629fd6-ed88-45d2-aa2e-280718608121-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2629fd6-ed88-45d2-aa2e-280718608121" (UID: "f2629fd6-ed88-45d2-aa2e-280718608121"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:34:55.096233 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.096161    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2629fd6-ed88-45d2-aa2e-280718608121" (UID: "f2629fd6-ed88-45d2-aa2e-280718608121"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:34:55.097619 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.097580    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2629fd6-ed88-45d2-aa2e-280718608121" (UID: "f2629fd6-ed88-45d2-aa2e-280718608121"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:34:55.097749 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.097695    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2629fd6-ed88-45d2-aa2e-280718608121" (UID: "f2629fd6-ed88-45d2-aa2e-280718608121"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:34:55.098067 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.098044    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2629fd6-ed88-45d2-aa2e-280718608121-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2629fd6-ed88-45d2-aa2e-280718608121" (UID: "f2629fd6-ed88-45d2-aa2e-280718608121"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:34:55.098067 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.098053    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-kube-api-access-s9b75" (OuterVolumeSpecName: "kube-api-access-s9b75") pod "f2629fd6-ed88-45d2-aa2e-280718608121" (UID: "f2629fd6-ed88-45d2-aa2e-280718608121"). InnerVolumeSpecName "kube-api-access-s9b75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:34:55.196551 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.196511    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2629fd6-ed88-45d2-aa2e-280718608121-istio-podinfo\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:34:55.196551 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.196549    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-data\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:34:55.196831 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.196563    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9b75\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-kube-api-access-s9b75\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:34:55.196831 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.196576    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2629fd6-ed88-45d2-aa2e-280718608121-istio-token\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:34:55.196831 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.196587    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2629fd6-ed88-45d2-aa2e-280718608121-istio-envoy\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:34:55.196831 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.196627    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2629fd6-ed88-45d2-aa2e-280718608121-istiod-ca-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:34:55.900821 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.900785    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p" event={"ID":"f2629fd6-ed88-45d2-aa2e-280718608121","Type":"ContainerDied","Data":"bda990033c1fa42982e2a909ed418acdae6bff5c9e1f8ca5adfd880aa2c20190"}
Jul 17 19:34:55.900821 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.900814    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"
Jul 17 19:34:55.901347 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.900851    2558 scope.go:117] "RemoveContainer" containerID="4ecae59c5d1be3a8101350e755a441b9feadfe3d5434ae2f6a10cfa8c6fbb119"
Jul 17 19:34:55.923227 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.923190    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"]
Jul 17 19:34:55.926798 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:55.926767    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b6c908-openshift-default-b4988f969-9wv5p"]
Jul 17 19:34:56.716325 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:56.716284    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" path="/var/lib/kubelet/pods/f2629fd6-ed88-45d2-aa2e-280718608121/volumes"
Jul 17 19:34:57.885932 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:57.885898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:58.193693 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:58.193586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:58.484216 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:58.484122    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:34:58.946943 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:34:58.946887    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:01.459925 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:01.459887    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:01.562854 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:01.562812    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:01.679633 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:01.679538    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:01.779430 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:01.779331    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:02.319663 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:02.319586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:02.414743 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:02.414706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:05.940675 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:05.940632    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:14.030184 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:14.030083    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:15.904807 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:15.904762    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:16.005244 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:16.005199    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:23.098157 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:23.098116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:23.198868 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:23.198827    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:32.391037 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:32.390973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:36.295339 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:36.295290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:35:58.130759 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:35:58.130705    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:36:15.783735 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:36:15.783697    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:37:18.418224 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:37:18.418127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:37:41.304041 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:37:41.304004    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:37:42.380699 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:37:42.380662    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:37:50.141464 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:37:50.141431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:38:06.088905 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:38:06.088862    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:38:18.738821 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:38:18.738731    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:38:26.699958 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:38:26.699918    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:38:26.759865 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:38:26.759833    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:39:02.346667 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:02.346593    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:39:02.446819 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:02.446778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:39:05.924978 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:05.924942    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:39:06.744042 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:06.744001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:39:16.832082 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:16.832038    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:39:46.697411 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:46.697306    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:39:48.886400 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:48.886365    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:39:48.894512 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:48.894483    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:39:48.894866 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:48.894847    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:39:48.902225 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:39:48.902202    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2cbz_1d18f624-cf3c-4582-8e2a-f865c68b0168/ovn-acl-logging/0.log"
Jul 17 19:40:16.869192 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:16.869154    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:40:16.970292 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:16.970234    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:40:23.865341 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:23.865302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:40:23.966087 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:23.966033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:40:29.958357 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:29.958317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:40:30.919587 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:30.919544    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:40:31.816829 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.816790    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7507-139919878858800"]
Jul 17 19:40:31.817230 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.817192    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy"
Jul 17 19:40:31.817230 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.817203    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy"
Jul 17 19:40:31.817302 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.817265    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy"
Jul 17 19:40:31.817302 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.817275    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy"
Jul 17 19:40:31.817302 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.817284    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="83c052b5-d032-4fb6-bab7-13335e4709d4" containerName="istio-proxy"
Jul 17 19:40:31.820639 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.820597    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919878858800"
Jul 17 19:40:31.823053 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.823028    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6kh8w\""
Jul 17 19:40:31.824841 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.824813    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919878858800"]
Jul 17 19:40:31.953067 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:31.953027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpzv\" (UniqueName: \"kubernetes.io/projected/46efaaeb-ea91-4b66-a876-556dfb4f8a5b-kube-api-access-mmpzv\") pod \"test-curl-7507-139919878858800\" (UID: \"46efaaeb-ea91-4b66-a876-556dfb4f8a5b\") " pod="opendatahub/test-curl-7507-139919878858800"
Jul 17 19:40:32.054218 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:32.054163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpzv\" (UniqueName: \"kubernetes.io/projected/46efaaeb-ea91-4b66-a876-556dfb4f8a5b-kube-api-access-mmpzv\") pod \"test-curl-7507-139919878858800\" (UID: \"46efaaeb-ea91-4b66-a876-556dfb4f8a5b\") " pod="opendatahub/test-curl-7507-139919878858800"
Jul 17 19:40:32.062643 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:32.062577    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpzv\" (UniqueName: \"kubernetes.io/projected/46efaaeb-ea91-4b66-a876-556dfb4f8a5b-kube-api-access-mmpzv\") pod \"test-curl-7507-139919878858800\" (UID: \"46efaaeb-ea91-4b66-a876-556dfb4f8a5b\") " pod="opendatahub/test-curl-7507-139919878858800"
Jul 17 19:40:32.132737 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:32.132687    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919878858800"
Jul 17 19:40:32.279352 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:32.279326    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919878858800"]
Jul 17 19:40:32.281763 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:40:32.281728    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46efaaeb_ea91_4b66_a876_556dfb4f8a5b.slice/crio-3613c67f3f91a84d8bb0b703b949583b7a8c1c1b12ef6b6ec8d130a59aa2c09f WatchSource:0}: Error finding container 3613c67f3f91a84d8bb0b703b949583b7a8c1c1b12ef6b6ec8d130a59aa2c09f: Status 404 returned error can't find the container with id 3613c67f3f91a84d8bb0b703b949583b7a8c1c1b12ef6b6ec8d130a59aa2c09f
Jul 17 19:40:32.283209 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:32.283187    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 19:40:32.637071 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:32.637031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919878858800" event={"ID":"46efaaeb-ea91-4b66-a876-556dfb4f8a5b","Type":"ContainerStarted","Data":"3613c67f3f91a84d8bb0b703b949583b7a8c1c1b12ef6b6ec8d130a59aa2c09f"}
Jul 17 19:40:33.644153 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:33.644113    2558 generic.go:356] "Generic (PLEG): container finished" podID="46efaaeb-ea91-4b66-a876-556dfb4f8a5b" containerID="8a227f85750f584567b620d3faf244c755da0ab51c6c73128c3eb74517b0bc0a" exitCode=0
Jul 17 19:40:33.644539 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:33.644200    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919878858800" event={"ID":"46efaaeb-ea91-4b66-a876-556dfb4f8a5b","Type":"ContainerDied","Data":"8a227f85750f584567b620d3faf244c755da0ab51c6c73128c3eb74517b0bc0a"}
Jul 17 19:40:34.798541 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.798511    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919878858800"
Jul 17 19:40:34.823281 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.823247    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7507-139919878858800_46efaaeb-ea91-4b66-a876-556dfb4f8a5b/test-curl-7507-139919878858800/0.log"
Jul 17 19:40:34.845195 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.845146    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7507-139919878858800"]
Jul 17 19:40:34.851303 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.851267    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7507-139919878858800"]
Jul 17 19:40:34.881812 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.881780    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmpzv\" (UniqueName: \"kubernetes.io/projected/46efaaeb-ea91-4b66-a876-556dfb4f8a5b-kube-api-access-mmpzv\") pod \"46efaaeb-ea91-4b66-a876-556dfb4f8a5b\" (UID: \"46efaaeb-ea91-4b66-a876-556dfb4f8a5b\") "
Jul 17 19:40:34.884006 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.883977    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46efaaeb-ea91-4b66-a876-556dfb4f8a5b-kube-api-access-mmpzv" (OuterVolumeSpecName: "kube-api-access-mmpzv") pod "46efaaeb-ea91-4b66-a876-556dfb4f8a5b" (UID: "46efaaeb-ea91-4b66-a876-556dfb4f8a5b"). InnerVolumeSpecName "kube-api-access-mmpzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:40:34.973169 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.973084    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7507-139919878860592"]
Jul 17 19:40:34.973487 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.973474    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46efaaeb-ea91-4b66-a876-556dfb4f8a5b" containerName="test-curl-7507-139919878858800"
Jul 17 19:40:34.973533 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.973489    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="46efaaeb-ea91-4b66-a876-556dfb4f8a5b" containerName="test-curl-7507-139919878858800"
Jul 17 19:40:34.973533 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.973508    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy"
Jul 17 19:40:34.973533 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.973514    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2629fd6-ed88-45d2-aa2e-280718608121" containerName="istio-proxy"
Jul 17 19:40:34.973660 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.973579    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="46efaaeb-ea91-4b66-a876-556dfb4f8a5b" containerName="test-curl-7507-139919878858800"
Jul 17 19:40:34.976720 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.976703    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919878860592"
Jul 17 19:40:34.983022 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.982990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8smdx\" (UniqueName: \"kubernetes.io/projected/04eaa68e-e9ea-43d2-894b-317edae31da5-kube-api-access-8smdx\") pod \"test-curl-7507-139919878860592\" (UID: \"04eaa68e-e9ea-43d2-894b-317edae31da5\") " pod="opendatahub/test-curl-7507-139919878860592"
Jul 17 19:40:34.983197 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.983059    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmpzv\" (UniqueName: \"kubernetes.io/projected/46efaaeb-ea91-4b66-a876-556dfb4f8a5b-kube-api-access-mmpzv\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:40:34.983556 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:34.983532    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919878860592"]
Jul 17 19:40:35.084376 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:35.084337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smdx\" (UniqueName: \"kubernetes.io/projected/04eaa68e-e9ea-43d2-894b-317edae31da5-kube-api-access-8smdx\") pod \"test-curl-7507-139919878860592\" (UID: \"04eaa68e-e9ea-43d2-894b-317edae31da5\") " pod="opendatahub/test-curl-7507-139919878860592"
Jul 17 19:40:35.092951 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:35.092920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8smdx\" (UniqueName: \"kubernetes.io/projected/04eaa68e-e9ea-43d2-894b-317edae31da5-kube-api-access-8smdx\") pod \"test-curl-7507-139919878860592\" (UID: \"04eaa68e-e9ea-43d2-894b-317edae31da5\") " pod="opendatahub/test-curl-7507-139919878860592"
Jul 17 19:40:35.288535 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:35.288446    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919878860592"
Jul 17 19:40:35.430494 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:35.430469    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919878860592"]
Jul 17 19:40:35.432399 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:40:35.432355    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04eaa68e_e9ea_43d2_894b_317edae31da5.slice/crio-a9c1725f7714420f0d6d49b4bcedf944defebc1ea503a0f1af53945c6e68e8ff WatchSource:0}: Error finding container a9c1725f7714420f0d6d49b4bcedf944defebc1ea503a0f1af53945c6e68e8ff: Status 404 returned error can't find the container with id a9c1725f7714420f0d6d49b4bcedf944defebc1ea503a0f1af53945c6e68e8ff
Jul 17 19:40:35.660270 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:35.660238    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919878858800"
Jul 17 19:40:35.660486 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:35.660273    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3613c67f3f91a84d8bb0b703b949583b7a8c1c1b12ef6b6ec8d130a59aa2c09f"
Jul 17 19:40:35.661775 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:35.661738    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919878860592" event={"ID":"04eaa68e-e9ea-43d2-894b-317edae31da5","Type":"ContainerStarted","Data":"a9c1725f7714420f0d6d49b4bcedf944defebc1ea503a0f1af53945c6e68e8ff"}
Jul 17 19:40:35.671883 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:40:35.671850    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7507-139919878858800\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="46efaaeb-ea91-4b66-a876-556dfb4f8a5b" pod="opendatahub/test-curl-7507-139919878858800"
Jul 17 19:40:36.668576 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:36.668540    2558 generic.go:356] "Generic (PLEG): container finished" podID="04eaa68e-e9ea-43d2-894b-317edae31da5" containerID="bff73bef53fcfdd7c1065bf02254d64e43afa823470b53aa52c3c9028aaa45c6" exitCode=0
Jul 17 19:40:36.669067 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:36.668630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919878860592" event={"ID":"04eaa68e-e9ea-43d2-894b-317edae31da5","Type":"ContainerDied","Data":"bff73bef53fcfdd7c1065bf02254d64e43afa823470b53aa52c3c9028aaa45c6"}
Jul 17 19:40:36.689222 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:40:36.689182    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7507-139919878858800\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="46efaaeb-ea91-4b66-a876-556dfb4f8a5b" pod="opendatahub/test-curl-7507-139919878858800"
Jul 17 19:40:36.717073 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:36.717028    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46efaaeb-ea91-4b66-a876-556dfb4f8a5b" path="/var/lib/kubelet/pods/46efaaeb-ea91-4b66-a876-556dfb4f8a5b/volumes"
Jul 17 19:40:37.819001 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:37.818971    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919878860592"
Jul 17 19:40:37.841183 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:37.841139    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7507-139919878860592_04eaa68e-e9ea-43d2-894b-317edae31da5/test-curl-7507-139919878860592/0.log"
Jul 17 19:40:37.868746 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:37.868703    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7507-139919878860592"]
Jul 17 19:40:37.871008 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:37.870984    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7507-139919878860592"]
Jul 17 19:40:37.907571 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:37.907538    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8smdx\" (UniqueName: \"kubernetes.io/projected/04eaa68e-e9ea-43d2-894b-317edae31da5-kube-api-access-8smdx\") pod \"04eaa68e-e9ea-43d2-894b-317edae31da5\" (UID: \"04eaa68e-e9ea-43d2-894b-317edae31da5\") "
Jul 17 19:40:37.909926 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:37.909897    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04eaa68e-e9ea-43d2-894b-317edae31da5-kube-api-access-8smdx" (OuterVolumeSpecName: "kube-api-access-8smdx") pod "04eaa68e-e9ea-43d2-894b-317edae31da5" (UID: "04eaa68e-e9ea-43d2-894b-317edae31da5"). InnerVolumeSpecName "kube-api-access-8smdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:40:38.008418 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.008300    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8smdx\" (UniqueName: \"kubernetes.io/projected/04eaa68e-e9ea-43d2-894b-317edae31da5-kube-api-access-8smdx\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:40:38.027310 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.027275    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:38.027726 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.027711    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04eaa68e-e9ea-43d2-894b-317edae31da5" containerName="test-curl-7507-139919878860592"
Jul 17 19:40:38.027783 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.027727    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="04eaa68e-e9ea-43d2-894b-317edae31da5" containerName="test-curl-7507-139919878860592"
Jul 17 19:40:38.027833 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.027823    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="04eaa68e-e9ea-43d2-894b-317edae31da5" containerName="test-curl-7507-139919878860592"
Jul 17 19:40:38.030789 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.030766    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:38.034996 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.034971    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:38.108951 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.108912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j29ps\" (UniqueName: \"kubernetes.io/projected/a4f87c4e-b50b-4e90-b72d-8f9129498407-kube-api-access-j29ps\") pod \"test-curl-7507-139919876460592\" (UID: \"a4f87c4e-b50b-4e90-b72d-8f9129498407\") " pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:38.210377 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.210336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j29ps\" (UniqueName: \"kubernetes.io/projected/a4f87c4e-b50b-4e90-b72d-8f9129498407-kube-api-access-j29ps\") pod \"test-curl-7507-139919876460592\" (UID: \"a4f87c4e-b50b-4e90-b72d-8f9129498407\") " pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:38.219445 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.219414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j29ps\" (UniqueName: \"kubernetes.io/projected/a4f87c4e-b50b-4e90-b72d-8f9129498407-kube-api-access-j29ps\") pod \"test-curl-7507-139919876460592\" (UID: \"a4f87c4e-b50b-4e90-b72d-8f9129498407\") " pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:38.342353 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.342309    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:38.486447 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.486419    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:38.489133 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:40:38.489108    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4f87c4e_b50b_4e90_b72d_8f9129498407.slice/crio-333f42d1f1787f2cc8257059f08c44ead839fca6299ba308a4edbaf168284bff WatchSource:0}: Error finding container 333f42d1f1787f2cc8257059f08c44ead839fca6299ba308a4edbaf168284bff: Status 404 returned error can't find the container with id 333f42d1f1787f2cc8257059f08c44ead839fca6299ba308a4edbaf168284bff
Jul 17 19:40:38.679854 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.679762    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9c1725f7714420f0d6d49b4bcedf944defebc1ea503a0f1af53945c6e68e8ff"
Jul 17 19:40:38.679854 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.679777    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919878860592"
Jul 17 19:40:38.681122 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.681092    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919876460592" event={"ID":"a4f87c4e-b50b-4e90-b72d-8f9129498407","Type":"ContainerStarted","Data":"333f42d1f1787f2cc8257059f08c44ead839fca6299ba308a4edbaf168284bff"}
Jul 17 19:40:38.691009 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:40:38.690971    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7507-139919878860592\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="04eaa68e-e9ea-43d2-894b-317edae31da5" pod="opendatahub/test-curl-7507-139919878860592"
Jul 17 19:40:38.713836 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:40:38.713801    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7507-139919878860592\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="04eaa68e-e9ea-43d2-894b-317edae31da5" pod="opendatahub/test-curl-7507-139919878860592"
Jul 17 19:40:38.715465 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:38.715436    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04eaa68e-e9ea-43d2-894b-317edae31da5" path="/var/lib/kubelet/pods/04eaa68e-e9ea-43d2-894b-317edae31da5/volumes"
Jul 17 19:40:39.687897 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:39.687858    2558 generic.go:356] "Generic (PLEG): container finished" podID="a4f87c4e-b50b-4e90-b72d-8f9129498407" containerID="6efd1fee6581cfb334eb03d5b01b2707b31b8eface62c334d5f21729506cf847" exitCode=0
Jul 17 19:40:39.688280 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:39.687944    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919876460592" event={"ID":"a4f87c4e-b50b-4e90-b72d-8f9129498407","Type":"ContainerDied","Data":"6efd1fee6581cfb334eb03d5b01b2707b31b8eface62c334d5f21729506cf847"}
Jul 17 19:40:40.841732 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:40.841706    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:40.863699 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:40.863661    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7507-139919876460592_a4f87c4e-b50b-4e90-b72d-8f9129498407/test-curl-7507-139919876460592/0.log"
Jul 17 19:40:40.883291 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:40.883251    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:40.888013 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:40.887978    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:40.935119 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:40.935083    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j29ps\" (UniqueName: \"kubernetes.io/projected/a4f87c4e-b50b-4e90-b72d-8f9129498407-kube-api-access-j29ps\") pod \"a4f87c4e-b50b-4e90-b72d-8f9129498407\" (UID: \"a4f87c4e-b50b-4e90-b72d-8f9129498407\") "
Jul 17 19:40:40.937372 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:40.937347    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4f87c4e-b50b-4e90-b72d-8f9129498407-kube-api-access-j29ps" (OuterVolumeSpecName: "kube-api-access-j29ps") pod "a4f87c4e-b50b-4e90-b72d-8f9129498407" (UID: "a4f87c4e-b50b-4e90-b72d-8f9129498407"). InnerVolumeSpecName "kube-api-access-j29ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:40:41.006732 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.006629    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:41.007135 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.007116    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f87c4e-b50b-4e90-b72d-8f9129498407" containerName="test-curl-7507-139919876460592"
Jul 17 19:40:41.007221 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.007137    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f87c4e-b50b-4e90-b72d-8f9129498407" containerName="test-curl-7507-139919876460592"
Jul 17 19:40:41.007288 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.007260    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f87c4e-b50b-4e90-b72d-8f9129498407" containerName="test-curl-7507-139919876460592"
Jul 17 19:40:41.010248 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.010226    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:41.019418 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.019389    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:41.036182 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.036146    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2plf9\" (UniqueName: \"kubernetes.io/projected/8e480f17-8b58-47ee-9fe2-79d37d5383ef-kube-api-access-2plf9\") pod \"test-curl-7507-139919876460592\" (UID: \"8e480f17-8b58-47ee-9fe2-79d37d5383ef\") " pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:41.036355 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.036260    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j29ps\" (UniqueName: \"kubernetes.io/projected/a4f87c4e-b50b-4e90-b72d-8f9129498407-kube-api-access-j29ps\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:40:41.137479 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.137440    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2plf9\" (UniqueName: \"kubernetes.io/projected/8e480f17-8b58-47ee-9fe2-79d37d5383ef-kube-api-access-2plf9\") pod \"test-curl-7507-139919876460592\" (UID: \"8e480f17-8b58-47ee-9fe2-79d37d5383ef\") " pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:41.149786 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.149748    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2plf9\" (UniqueName: \"kubernetes.io/projected/8e480f17-8b58-47ee-9fe2-79d37d5383ef-kube-api-access-2plf9\") pod \"test-curl-7507-139919876460592\" (UID: \"8e480f17-8b58-47ee-9fe2-79d37d5383ef\") " pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:41.321039 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.320944    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:41.489708 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.489672    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:41.493979 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:40:41.493952    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e480f17_8b58_47ee_9fe2_79d37d5383ef.slice/crio-3b56b0a873293115f45e6719ab711a90239b0a4cee15782cb2686afb44f9ae4c WatchSource:0}: Error finding container 3b56b0a873293115f45e6719ab711a90239b0a4cee15782cb2686afb44f9ae4c: Status 404 returned error can't find the container with id 3b56b0a873293115f45e6719ab711a90239b0a4cee15782cb2686afb44f9ae4c
Jul 17 19:40:41.699773 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.699743    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="333f42d1f1787f2cc8257059f08c44ead839fca6299ba308a4edbaf168284bff"
Jul 17 19:40:41.699773 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.699745    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:41.701062 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.701027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919876460592" event={"ID":"8e480f17-8b58-47ee-9fe2-79d37d5383ef","Type":"ContainerStarted","Data":"3b56b0a873293115f45e6719ab711a90239b0a4cee15782cb2686afb44f9ae4c"}
Jul 17 19:40:41.712357 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:41.712319    2558 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7507-139919876460592" oldPodUID="a4f87c4e-b50b-4e90-b72d-8f9129498407" podUID="8e480f17-8b58-47ee-9fe2-79d37d5383ef"
Jul 17 19:40:42.707950 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:42.707918    2558 generic.go:356] "Generic (PLEG): container finished" podID="8e480f17-8b58-47ee-9fe2-79d37d5383ef" containerID="702f8db46e672dd6fa02a25580da4a5838164452e605bcb45c298bcadfa7e2a7" exitCode=0
Jul 17 19:40:42.708382 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:42.708011    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919876460592" event={"ID":"8e480f17-8b58-47ee-9fe2-79d37d5383ef","Type":"ContainerDied","Data":"702f8db46e672dd6fa02a25580da4a5838164452e605bcb45c298bcadfa7e2a7"}
Jul 17 19:40:42.715018 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:42.714984    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4f87c4e-b50b-4e90-b72d-8f9129498407" path="/var/lib/kubelet/pods/a4f87c4e-b50b-4e90-b72d-8f9129498407/volumes"
Jul 17 19:40:43.862176 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:43.862148    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:43.882464 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:43.882430    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7507-139919876460592_8e480f17-8b58-47ee-9fe2-79d37d5383ef/test-curl-7507-139919876460592/0.log"
Jul 17 19:40:43.905287 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:43.905255    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:43.908701 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:43.908672    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7507-139919876460592"]
Jul 17 19:40:43.961955 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:43.961925    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2plf9\" (UniqueName: \"kubernetes.io/projected/8e480f17-8b58-47ee-9fe2-79d37d5383ef-kube-api-access-2plf9\") pod \"8e480f17-8b58-47ee-9fe2-79d37d5383ef\" (UID: \"8e480f17-8b58-47ee-9fe2-79d37d5383ef\") "
Jul 17 19:40:43.964302 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:43.964225    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e480f17-8b58-47ee-9fe2-79d37d5383ef-kube-api-access-2plf9" (OuterVolumeSpecName: "kube-api-access-2plf9") pod "8e480f17-8b58-47ee-9fe2-79d37d5383ef" (UID: "8e480f17-8b58-47ee-9fe2-79d37d5383ef"). InnerVolumeSpecName "kube-api-access-2plf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:40:44.016079 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.016043    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7507-139919876461600"]
Jul 17 19:40:44.016549 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.016530    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e480f17-8b58-47ee-9fe2-79d37d5383ef" containerName="test-curl-7507-139919876460592"
Jul 17 19:40:44.016673 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.016552    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e480f17-8b58-47ee-9fe2-79d37d5383ef" containerName="test-curl-7507-139919876460592"
Jul 17 19:40:44.016741 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.016696    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e480f17-8b58-47ee-9fe2-79d37d5383ef" containerName="test-curl-7507-139919876460592"
Jul 17 19:40:44.019737 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.019715    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876461600"
Jul 17 19:40:44.025276 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.025248    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919876461600"]
Jul 17 19:40:44.063389 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.063345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-224vd\" (UniqueName: \"kubernetes.io/projected/57e85a6b-52a3-44c0-8300-30e52da7b29a-kube-api-access-224vd\") pod \"test-curl-7507-139919876461600\" (UID: \"57e85a6b-52a3-44c0-8300-30e52da7b29a\") " pod="opendatahub/test-curl-7507-139919876461600"
Jul 17 19:40:44.063552 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.063456    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2plf9\" (UniqueName: \"kubernetes.io/projected/8e480f17-8b58-47ee-9fe2-79d37d5383ef-kube-api-access-2plf9\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:40:44.164138 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.164100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-224vd\" (UniqueName: \"kubernetes.io/projected/57e85a6b-52a3-44c0-8300-30e52da7b29a-kube-api-access-224vd\") pod \"test-curl-7507-139919876461600\" (UID: \"57e85a6b-52a3-44c0-8300-30e52da7b29a\") " pod="opendatahub/test-curl-7507-139919876461600"
Jul 17 19:40:44.172359 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.172324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-224vd\" (UniqueName: \"kubernetes.io/projected/57e85a6b-52a3-44c0-8300-30e52da7b29a-kube-api-access-224vd\") pod \"test-curl-7507-139919876461600\" (UID: \"57e85a6b-52a3-44c0-8300-30e52da7b29a\") " pod="opendatahub/test-curl-7507-139919876461600"
Jul 17 19:40:44.331215 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.331183    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876461600"
Jul 17 19:40:44.474528 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.474502    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-139919876461600"]
Jul 17 19:40:44.475988 ip-10-0-138-143 kubenswrapper[2558]: W0717 19:40:44.475963    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57e85a6b_52a3_44c0_8300_30e52da7b29a.slice/crio-658638db78552604029728653d3b5856440597291512be693a4c6c9dbe2cfe65 WatchSource:0}: Error finding container 658638db78552604029728653d3b5856440597291512be693a4c6c9dbe2cfe65: Status 404 returned error can't find the container with id 658638db78552604029728653d3b5856440597291512be693a4c6c9dbe2cfe65
Jul 17 19:40:44.716662 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.716559    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e480f17-8b58-47ee-9fe2-79d37d5383ef" path="/var/lib/kubelet/pods/8e480f17-8b58-47ee-9fe2-79d37d5383ef/volumes"
Jul 17 19:40:44.721073 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.721033    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919876461600" event={"ID":"57e85a6b-52a3-44c0-8300-30e52da7b29a","Type":"ContainerStarted","Data":"658638db78552604029728653d3b5856440597291512be693a4c6c9dbe2cfe65"}
Jul 17 19:40:44.722248 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.722228    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876460592"
Jul 17 19:40:44.722248 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:44.722248    2558 scope.go:117] "RemoveContainer" containerID="702f8db46e672dd6fa02a25580da4a5838164452e605bcb45c298bcadfa7e2a7"
Jul 17 19:40:45.729178 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:45.729143    2558 generic.go:356] "Generic (PLEG): container finished" podID="57e85a6b-52a3-44c0-8300-30e52da7b29a" containerID="0b4aa18058cc06f9a69d412d15fbd727d83d49fb5f10c74a925a23aaca9d4d26" exitCode=0
Jul 17 19:40:45.729671 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:45.729231    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-139919876461600" event={"ID":"57e85a6b-52a3-44c0-8300-30e52da7b29a","Type":"ContainerDied","Data":"0b4aa18058cc06f9a69d412d15fbd727d83d49fb5f10c74a925a23aaca9d4d26"}
Jul 17 19:40:46.886954 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:46.886928    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876461600"
Jul 17 19:40:46.907526 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:46.907495    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7507-139919876461600_57e85a6b-52a3-44c0-8300-30e52da7b29a/test-curl-7507-139919876461600/0.log"
Jul 17 19:40:46.928347 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:46.928312    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7507-139919876461600"]
Jul 17 19:40:46.932287 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:46.932255    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7507-139919876461600"]
Jul 17 19:40:46.988925 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:46.988829    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-224vd\" (UniqueName: \"kubernetes.io/projected/57e85a6b-52a3-44c0-8300-30e52da7b29a-kube-api-access-224vd\") pod \"57e85a6b-52a3-44c0-8300-30e52da7b29a\" (UID: \"57e85a6b-52a3-44c0-8300-30e52da7b29a\") "
Jul 17 19:40:46.991117 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:46.991091    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57e85a6b-52a3-44c0-8300-30e52da7b29a-kube-api-access-224vd" (OuterVolumeSpecName: "kube-api-access-224vd") pod "57e85a6b-52a3-44c0-8300-30e52da7b29a" (UID: "57e85a6b-52a3-44c0-8300-30e52da7b29a"). InnerVolumeSpecName "kube-api-access-224vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:40:47.090051 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:47.090008    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-224vd\" (UniqueName: \"kubernetes.io/projected/57e85a6b-52a3-44c0-8300-30e52da7b29a-kube-api-access-224vd\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 17 19:40:47.741483 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:47.741452    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-139919876461600"
Jul 17 19:40:47.741718 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:47.741496    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="658638db78552604029728653d3b5856440597291512be693a4c6c9dbe2cfe65"
Jul 17 19:40:47.754426 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:40:47.754390    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7507-139919876461600\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="57e85a6b-52a3-44c0-8300-30e52da7b29a" pod="opendatahub/test-curl-7507-139919876461600"
Jul 17 19:40:48.713379 ip-10-0-138-143 kubenswrapper[2558]: E0717 19:40:48.713340    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7507-139919876461600\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="57e85a6b-52a3-44c0-8300-30e52da7b29a" pod="opendatahub/test-curl-7507-139919876461600"
Jul 17 19:40:48.716500 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:48.716465    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57e85a6b-52a3-44c0-8300-30e52da7b29a" path="/var/lib/kubelet/pods/57e85a6b-52a3-44c0-8300-30e52da7b29a/volumes"
Jul 17 19:40:50.627005 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:50.626964    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:40:50.729874 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:40:50.729832    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:00.605893 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:00.605851    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:05.216160 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:05.216114    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:11.161632 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:11.161511    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:11.222707 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:11.222676    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:15.896074 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:15.896024    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:16.123592 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:16.123544    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:16.890548 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:16.890506    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:16.993254 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:16.993218    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:26.718228 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:26.718184    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:31.324783 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:31.324741    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:37.382760 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:37.382720    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:37.440833 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:37.440798    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:42.003931 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:42.003890    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:42.514077 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:42.514038    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:41:42.694528 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:42.694497    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79698fdf5d-6nt4d_c3d4154f-6fc4-43cb-b7c2-83d08f06fce4/authorino/0.log"
Jul 17 19:41:48.119473 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:48.119433    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qllzr_406246ff-d678-4439-bed5-069aba7c7cb0/manager/0.log"
Jul 17 19:41:48.253750 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:48.253710    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dmhgm_e92b0376-0e2c-4a38-85f7-7ca534c20a70/manager/0.log"
Jul 17 19:41:48.510459 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:48.510379    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rljgg_079136bb-07a8-427c-9167-016127000064/server/0.log"
Jul 17 19:41:48.631748 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:48.631712    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5m699_64229db7-428d-456f-82c0-38ef87c21438/manager/0.log"
Jul 17 19:41:48.897492 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:48.897452    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55dc8c5f-7qxrz_5e7fe309-fe30-4efe-9ce9-5eef12b06e74/copy-manifests/0.log"
Jul 17 19:41:48.916704 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:48.916672    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55dc8c5f-7qxrz_5e7fe309-fe30-4efe-9ce9-5eef12b06e74/manager/0.log"
Jul 17 19:41:49.381689 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:49.381648    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59dfc85689-js4c2_5c6709a9-c881-4925-ad89-7c20f812c612/maas-api/0.log"
Jul 17 19:41:51.039267 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:51.039236    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-lwzw8_7ed1ca51-2f13-4eea-a978-add90b353c4c/postgres/0.log"
Jul 17 19:41:52.377066 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:52.377034    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79698fdf5d-6nt4d_c3d4154f-6fc4-43cb-b7c2-83d08f06fce4/authorino/0.log"
Jul 17 19:41:52.500055 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:52.499996    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xks7x_a3194c85-1f44-42bc-94ab-9dd85c6addbe/manager/0.log"
Jul 17 19:41:52.610028 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:52.610001    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fm7tx_fb17a0b5-5253-43c2-9653-33edd2fbd55e/manager/0.log"
Jul 17 19:41:52.833616 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:52.833576    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5njkl_163c54e3-0a6f-49f8-80a1-7af67a477754/registry-server/0.log"
Jul 17 19:41:53.208495 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:53.208416    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lgvnl_3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253/manager/0.log"
Jul 17 19:41:53.785700 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:53.785667    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf547cfd-66lqs_c074e1b9-0e93-4506-aab2-fb9129901dc2/kube-auth-proxy/0.log"
Jul 17 19:41:54.023403 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:54.023361    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vhldp_fa11453f-12be-47ec-b462-0d99b03644f8/istio-proxy/1.log"
Jul 17 19:41:54.267078 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:54.267032    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-7m545_62c40740-88f8-40fe-91d7-318b5986ef97/payload-processing/0.log"
Jul 17 19:41:54.378992 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:54.378962    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75d9b569c6-grjnm_d08e0539-ce5f-4636-93ed-6fd344b871cc/router/0.log"
Jul 17 19:41:54.717553 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:54.717521    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-252nf_b9c358ec-bf9a-4a3d-bb8f-8c9957f99e52/main/0.log"
Jul 17 19:41:55.056617 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:55.056509    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwf5sq_eb8fc268-707c-422d-b631-088679fce0e4/main/0.log"
Jul 17 19:41:55.164716 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:41:55.164687    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-x6qwn_b00abe18-f8a8-4d39-bbfb-01d7622edc3b/main/0.log"
Jul 17 19:42:01.167485 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:01.167445    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:42:01.265140 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:01.265086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log" limit=1024
Jul 17 19:42:04.135942 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:04.135909    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h9wdv_f81b37e7-4f8b-42e9-8af1-187f5d26cd27/global-pull-secret-syncer/0.log"
Jul 17 19:42:04.241003 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:04.240970    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-27zjz_7767ae00-af27-49e0-97bd-c67d3b3bbf32/konnectivity-agent/0.log"
Jul 17 19:42:04.383903 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:04.383870    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-143.ec2.internal_b627e4843adfbd64039515f41cb64e53/haproxy/0.log"
Jul 17 19:42:09.758962 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:09.758920    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79698fdf5d-6nt4d_c3d4154f-6fc4-43cb-b7c2-83d08f06fce4/authorino/0.log"
Jul 17 19:42:09.791776 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:09.791740    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xks7x_a3194c85-1f44-42bc-94ab-9dd85c6addbe/manager/0.log"
Jul 17 19:42:09.816793 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:09.816756    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fm7tx_fb17a0b5-5253-43c2-9653-33edd2fbd55e/manager/0.log"
Jul 17 19:42:09.917053 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:09.917017    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5njkl_163c54e3-0a6f-49f8-80a1-7af67a477754/registry-server/0.log"
Jul 17 19:42:10.186043 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:10.186017    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lgvnl_3fcda26f-7b3b-4fa5-86d6-ee3f7cd15253/manager/0.log"
Jul 17 19:42:12.123491 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:12.123446    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-5qzqm_2d3fd2f0-0c3b-456b-ba0b-fcec148d229d/cluster-monitoring-operator/0.log"
Jul 17 19:42:12.358136 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:12.358107    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6gxn_0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca/node-exporter/0.log"
Jul 17 19:42:12.378788 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:12.378707    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6gxn_0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca/kube-rbac-proxy/0.log"
Jul 17 19:42:12.401311 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:12.401285    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6gxn_0fcf7adf-3308-401a-86bb-d7b4e7a2f4ca/init-textfile/0.log"
Jul 17 19:42:14.227820 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.227782    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-bnb98_6c2b0549-6cbe-42d0-a45d-ee858519c674/networking-console-plugin/0.log"
Jul 17 19:42:14.587326 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.587287    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"]
Jul 17 19:42:14.587797 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.587777    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e85a6b-52a3-44c0-8300-30e52da7b29a" containerName="test-curl-7507-139919876461600"
Jul 17 19:42:14.587911 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.587798    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e85a6b-52a3-44c0-8300-30e52da7b29a" containerName="test-curl-7507-139919876461600"
Jul 17 19:42:14.587911 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.587903    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="57e85a6b-52a3-44c0-8300-30e52da7b29a" containerName="test-curl-7507-139919876461600"
Jul 17 19:42:14.591203 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.591177    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.593537 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.593513    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8mpmt\"/\"default-dockercfg-zcdlp\""
Jul 17 19:42:14.593682 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.593551    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mpmt\"/\"openshift-service-ca.crt\""
Jul 17 19:42:14.594192 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.594171    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mpmt\"/\"kube-root-ca.crt\""
Jul 17 19:42:14.598217 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.598139    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"]
Jul 17 19:42:14.713777 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.713747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-lib-modules\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.713777 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.713777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-podres\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.714096 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.713816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sp66\" (UniqueName: \"kubernetes.io/projected/38197b42-0582-49a9-b623-8f060a67f8fc-kube-api-access-6sp66\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.714096 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.713870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-proc\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.714096 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.713928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-sys\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.814869 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.814831    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-lib-modules\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.814869 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.814869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-podres\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.815154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.814906    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sp66\" (UniqueName: \"kubernetes.io/projected/38197b42-0582-49a9-b623-8f060a67f8fc-kube-api-access-6sp66\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.815154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.814932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-proc\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.815154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.814980    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-sys\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.815154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.815041    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-podres\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.815154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.815047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-lib-modules\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.815154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.815077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-proc\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.815154 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.815128    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38197b42-0582-49a9-b623-8f060a67f8fc-sys\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.822969 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.822942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sp66\" (UniqueName: \"kubernetes.io/projected/38197b42-0582-49a9-b623-8f060a67f8fc-kube-api-access-6sp66\") pod \"perf-node-gather-daemonset-cbf6f\" (UID: \"38197b42-0582-49a9-b623-8f060a67f8fc\") " pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.895634 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.895500    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/1.log"
Jul 17 19:42:14.902047 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.901977    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:14.905851 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:14.905520    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-26vr8_05ff7f7e-fffb-4098-b6ca-a1b04622b4bc/console-operator/2.log"
Jul 17 19:42:15.050163 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:15.050133    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"]
Jul 17 19:42:15.206824 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:15.206781    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f" event={"ID":"38197b42-0582-49a9-b623-8f060a67f8fc","Type":"ContainerStarted","Data":"69f58a2d75f29a1a3115dd7901297b40ed9e5dc7268291691861798399fde966"}
Jul 17 19:42:15.207023 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:15.206840    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f" event={"ID":"38197b42-0582-49a9-b623-8f060a67f8fc","Type":"ContainerStarted","Data":"09691f880c44eefd866dae2fa4d00d36e190922a8782e4f1d635c64b5b8e33f7"}
Jul 17 19:42:15.207023 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:15.206863    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:15.225384 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:15.225334    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f" podStartSLOduration=1.225315013 podStartE2EDuration="1.225315013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:42:15.222730071 +0000 UTC m=+2846.963482871" watchObservedRunningTime="2026-07-17 19:42:15.225315013 +0000 UTC m=+2846.966067822"
Jul 17 19:42:16.147771 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:16.147737    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-h7sgx_ae0bb0ce-9178-4b58-9732-37e2b8795825/volume-data-source-validator/0.log"
Jul 17 19:42:17.277205 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:17.277172    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bl2v_e9ff6ec0-3a7e-4e0e-969c-a2619d47509a/dns/0.log"
Jul 17 19:42:17.303959 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:17.303926    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bl2v_e9ff6ec0-3a7e-4e0e-969c-a2619d47509a/kube-rbac-proxy/0.log"
Jul 17 19:42:17.439566 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:17.439536    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rxt25_0afd6108-c5dc-4376-ad7c-a8ed05fb69ac/dns-node-resolver/0.log"
Jul 17 19:42:18.033120 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:18.033073    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c99d4ff46-kwxgq_5779ec22-fcf5-420f-8674-47f62f4e1987/registry/0.log"
Jul 17 19:42:18.056325 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:18.056292    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4s9r8_e418ccff-ee04-4dad-bbd2-719e05a7f03d/node-ca/0.log"
Jul 17 19:42:19.224296 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:19.224263    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf547cfd-66lqs_c074e1b9-0e93-4506-aab2-fb9129901dc2/kube-auth-proxy/0.log"
Jul 17 19:42:19.289268 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:19.289238    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vhldp_fa11453f-12be-47ec-b462-0d99b03644f8/istio-proxy/0.log"
Jul 17 19:42:19.348179 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:19.348138    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vhldp_fa11453f-12be-47ec-b462-0d99b03644f8/istio-proxy/1.log"
Jul 17 19:42:19.429538 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:19.429499    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-7m545_62c40740-88f8-40fe-91d7-318b5986ef97/payload-processing/0.log"
Jul 17 19:42:19.454213 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:19.454177    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75d9b569c6-grjnm_d08e0539-ce5f-4636-93ed-6fd344b871cc/router/0.log"
Jul 17 19:42:20.172228 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:20.172193    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dtwgf_efa9c633-2f06-4ea2-8fa3-3b4b02b9809b/serve-healthcheck-canary/0.log"
Jul 17 19:42:20.722779 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:20.722742    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-pk4cb_5528a224-30ce-44ce-8f02-d15b9eadc6f0/insights-operator/0.log"
Jul 17 19:42:20.725726 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:20.725699    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-pk4cb_5528a224-30ce-44ce-8f02-d15b9eadc6f0/insights-operator/1.log"
Jul 17 19:42:20.823478 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:20.823451    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqwzr_4ec676bf-440e-46c4-9ec3-491d8eb3d022/kube-rbac-proxy/0.log"
Jul 17 19:42:20.849862 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:20.849829    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqwzr_4ec676bf-440e-46c4-9ec3-491d8eb3d022/exporter/0.log"
Jul 17 19:42:20.876926 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:20.876889    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqwzr_4ec676bf-440e-46c4-9ec3-491d8eb3d022/extractor/0.log"
Jul 17 19:42:21.224912 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:21.224870    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8mpmt/perf-node-gather-daemonset-cbf6f"
Jul 17 19:42:23.061554 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:23.061517    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qllzr_406246ff-d678-4439-bed5-069aba7c7cb0/manager/0.log"
Jul 17 19:42:23.311286 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:23.311249    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dmhgm_e92b0376-0e2c-4a38-85f7-7ca534c20a70/manager/0.log"
Jul 17 19:42:23.510935 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:23.510905    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rljgg_079136bb-07a8-427c-9167-016127000064/server/0.log"
Jul 17 19:42:23.621790 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:23.621759    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5m699_64229db7-428d-456f-82c0-38ef87c21438/manager/0.log"
Jul 17 19:42:23.783220 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:23.783121    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55dc8c5f-7qxrz_5e7fe309-fe30-4efe-9ce9-5eef12b06e74/manager/0.log"
Jul 17 19:42:23.802522 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:23.802496    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55dc8c5f-7qxrz_5e7fe309-fe30-4efe-9ce9-5eef12b06e74/copy-manifests/0.log"
Jul 17 19:42:25.027266 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:25.027166    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf547cfd-66lqs_c074e1b9-0e93-4506-aab2-fb9129901dc2/kube-auth-proxy/0.log"
Jul 17 19:42:25.079404 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:25.079365    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vhldp_fa11453f-12be-47ec-b462-0d99b03644f8/istio-proxy/0.log"
Jul 17 19:42:25.138832 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:25.138783    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vhldp_fa11453f-12be-47ec-b462-0d99b03644f8/istio-proxy/1.log"
Jul 17 19:42:25.197284 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:25.197245    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-7m545_62c40740-88f8-40fe-91d7-318b5986ef97/payload-processing/0.log"
Jul 17 19:42:25.215889 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:25.215843    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75d9b569c6-grjnm_d08e0539-ce5f-4636-93ed-6fd344b871cc/router/0.log"
Jul 17 19:42:26.646336 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:26.646302    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf547cfd-66lqs_c074e1b9-0e93-4506-aab2-fb9129901dc2/kube-auth-proxy/0.log"
Jul 17 19:42:26.696087 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:26.696047    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vhldp_fa11453f-12be-47ec-b462-0d99b03644f8/istio-proxy/0.log"
Jul 17 19:42:26.756480 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:26.756446    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vhldp_fa11453f-12be-47ec-b462-0d99b03644f8/istio-proxy/1.log"
Jul 17 19:42:26.825129 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:26.825096    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-7m545_62c40740-88f8-40fe-91d7-318b5986ef97/payload-processing/0.log"
Jul 17 19:42:26.844710 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:26.844674    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75d9b569c6-grjnm_d08e0539-ce5f-4636-93ed-6fd344b871cc/router/0.log"
Jul 17 19:42:30.974416 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:30.974369    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-tdnk9_baa58ad7-2905-476d-8941-0dc02e3bad75/kube-storage-version-migrator-operator/0.log"
Jul 17 19:42:31.974089 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:31.974058    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j289_4aed984b-c4cb-4681-81e1-42a4cb1b7f6a/kube-multus-additional-cni-plugins/0.log"
Jul 17 19:42:31.995990 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:31.995958    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j289_4aed984b-c4cb-4681-81e1-42a4cb1b7f6a/egress-router-binary-copy/0.log"
Jul 17 19:42:32.020025 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:32.019996    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j289_4aed984b-c4cb-4681-81e1-42a4cb1b7f6a/cni-plugins/0.log"
Jul 17 19:42:32.040838 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:32.040804    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j289_4aed984b-c4cb-4681-81e1-42a4cb1b7f6a/bond-cni-plugin/0.log"
Jul 17 19:42:32.063045 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:32.063016    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j289_4aed984b-c4cb-4681-81e1-42a4cb1b7f6a/routeoverride-cni/0.log"
Jul 17 19:42:32.085578 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:32.085540    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j289_4aed984b-c4cb-4681-81e1-42a4cb1b7f6a/whereabouts-cni-bincopy/0.log"
Jul 17 19:42:32.108211 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:32.108182    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j289_4aed984b-c4cb-4681-81e1-42a4cb1b7f6a/whereabouts-cni/0.log"
Jul 17 19:42:32.513092 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:32.513059    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pxqtj_c2ae9ddf-d138-4b59-ab7e-8e62d8c656a8/kube-multus/0.log"
Jul 17 19:42:32.629969 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:32.629936    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8xrbc_dc317da8-729e-4b00-bc8e-8694b867da64/network-metrics-daemon/0.log"
Jul 17 19:42:32.650047 ip-10-0-138-143 kubenswrapper[2558]: I0717 19:42:32.650002    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8xrbc_dc317da8-729e-4b00-bc8e-8694b867da64/kube-rbac-proxy/0.log"