Jul 20 02:44:51.652928 ip-10-0-140-191 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.057817    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061358    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061368    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061371    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061374    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061377    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061381    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061384    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 02:44:52.139002 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061387    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 02:44:52.127475 ip-10-0-140-191 systemd[1]: Started Kubernetes Kubelet.
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061390    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061394    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061398    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061401    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061404    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061407    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061410    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061413    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061416    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061419    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061421    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061423    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061426    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061433    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061436    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061438    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061441    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061443    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061446    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 02:44:52.141133 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061448    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061451    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061453    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061456    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061464    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061469    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061472    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061475    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061478    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061480    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061484    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061486    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061488    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061491    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061493    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061496    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061498    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061501    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061503    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061506    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 02:44:52.143177 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061508    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061511    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061513    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061516    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061518    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061521    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061523    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061527    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061529    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061532    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061534    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061538    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061540    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061543    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061545    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061548    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061551    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061554    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061556    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061558    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 02:44:52.144485 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061561    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061564    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061566    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061569    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061571    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061574    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061576    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061578    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061581    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061583    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061586    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061588    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061591    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061593    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061597    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061600    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061603    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061606    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061609    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 02:44:52.145989 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061611    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061614    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061617    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061620    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061622    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061624    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061627    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061630    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061632    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061652    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061657    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061659    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.061662    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062840    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062854    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062859    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062865    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062876    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062881    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062888    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 02:44:52.148552 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062892    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062897    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062902    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062906    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062912    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062916    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062921    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062926    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062931    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062948    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062953    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062958    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062962    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062966    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062973    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062978    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062982    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062987    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062991    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062995    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 02:44:52.150746 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.062999    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063004    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063451    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063569    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063584    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063589    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063594    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063599    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063603    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063607    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063610    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063614    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063618    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063622    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063625    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063629    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063649    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063655    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063661    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 02:44:52.152768 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063666    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063671    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063675    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063678    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063683    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063687    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063692    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063696    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063700    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063703    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063708    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063720    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063724    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063728    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063731    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063736    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063741    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063745    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063766    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063770    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063775    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 02:44:52.153570 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063778    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063782    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063786    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063792    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063796    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063800    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063803    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063807    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063810    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063814    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063818    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063822    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063825    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063831    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063835    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063839    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063843    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063847    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063850    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 02:44:52.156086 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063854    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063858    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063862    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063866    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063869    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063874    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063878    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063881    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063885    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063888    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063892    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063899    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.063904    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064421    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064428    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064434    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064439    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064443    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064447    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 02:44:52.157436 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064452    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064455    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064459    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064463    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064466    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064470    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064474    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064478    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064481    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064485    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064488    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064492    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064496    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064500    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064505    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064510    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064514    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064518    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064523    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064527    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 02:44:52.158336 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064530    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064533    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064537    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064540    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064546    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064574    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064579    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064583    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064589    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064593    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064597    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064602    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064606    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064609    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064613    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064617    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064621    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064625    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064629    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064632    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 02:44:52.159189 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064654    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064659    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064663    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064669    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064673    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064676    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064680    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064684    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064687    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064691    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064695    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064698    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064702    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064706    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064709    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064713    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064721    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064726    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064730    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 02:44:52.160096 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064735    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064740    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064745    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064749    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064753    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064756    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064760    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064766    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064769    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064773    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064776    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064780    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064784    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064787    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064791    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064794    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064798    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064802    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064805    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064809    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 02:44:52.160934 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064813    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064817    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064820    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064823    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064827    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064830    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064834    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064837    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064841    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064846    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064850    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064853    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064857    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.064862    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.064940    2584 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.064961    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.064970    2584 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.064976    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.064981    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.064986    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.064992    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 02:44:52.161944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.064997    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065002    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065006    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065010    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065015    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065019    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065022    2584 flags.go:64] FLAG: --cgroup-root=""
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065026    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065030    2584 flags.go:64] FLAG: --client-ca-file=""
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065034    2584 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065039    2584 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065045    2584 flags.go:64] FLAG: --cluster-domain=""
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065048    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065053    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065056    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065061    2584 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065066    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065070    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065074    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065079    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065084    2584 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065089    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065093    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065097    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 02:44:52.162574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065102    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065107    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065111    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065116    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065120    2584 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065124    2584 flags.go:64] FLAG: --enable-server="true"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065128    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065135    2584 flags.go:64] FLAG: --event-burst="100"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065139    2584 flags.go:64] FLAG: --event-qps="50"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065143    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065147    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065151    2584 flags.go:64] FLAG: --eviction-hard=""
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065156    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065160    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065164    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065169    2584 flags.go:64] FLAG: --eviction-soft=""
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065172    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065176    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065181    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065184    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065189    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065193    2584 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065197    2584 flags.go:64] FLAG: --feature-gates=""
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065202    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065206    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 02:44:52.163395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065211    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065215    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065219    2584 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065224    2584 flags.go:64] FLAG: --help="false"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065228    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065232    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065236    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065242    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065247    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065251    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065255    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065259    2584 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065263    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065267    2584 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065271    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065274    2584 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065279    2584 flags.go:64] FLAG: --kube-reserved=""
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065283    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065287    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065292    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065296    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065300    2584 flags.go:64] FLAG: --lock-file=""
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065303    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065307    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 02:44:52.164290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065311    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065319    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065325    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065329    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065333    2584 flags.go:64] FLAG: --logging-format="text"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065336    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065342    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065346    2584 flags.go:64] FLAG: --manifest-url=""
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065349    2584 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065355    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065358    2584 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065365    2584 flags.go:64] FLAG: --max-pods="110"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065369    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065374    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065377    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065382    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065386    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065390    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065394    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065403    2584 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065407    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065411    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065415    2584 flags.go:64] FLAG: --pod-cidr=""
Jul 20 02:44:52.165254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065419    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065427    2584 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065431    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065435    2584 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065439    2584 flags.go:64] FLAG: --port="10250"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065443    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065448    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d60076facac70b1"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065452    2584 flags.go:64] FLAG: --qos-reserved=""
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065456    2584 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065459    2584 flags.go:64] FLAG: --register-node="true"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065463    2584 flags.go:64] FLAG: --register-with-taints=""
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065468    2584 flags.go:64] FLAG: --registry-burst="10"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065472    2584 flags.go:64] FLAG: --registry-qps="5"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065476    2584 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065480    2584 flags.go:64] FLAG: --reserved-memory=""
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065485    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065489    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065493    2584 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065497    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065501    2584 flags.go:64] FLAG: --runonce="false"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065504    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065510    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065514    2584 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065518    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065523    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065527    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 02:44:52.166629 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065532    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065535    2584 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065539    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065544    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065547    2584 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065551    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065555    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065558    2584 flags.go:64] FLAG: --system-cgroups=""
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065562    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065569    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065573    2584 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065577    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065583    2584 flags.go:64] FLAG: --tls-min-version=""
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065586    2584 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065590    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065594    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065598    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065602    2584 flags.go:64] FLAG: --v="2"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065606    2584 flags.go:64] FLAG: --version="false"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065612    2584 flags.go:64] FLAG: --vmodule=""
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065618    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.065622    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065791    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065797    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 02:44:52.167560 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065801    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065805    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065809    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065813    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065817    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065821    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065826    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065829    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065833    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065837    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065840    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065844    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065848    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065852    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065856    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065859    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065863    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065867    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065871    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 02:44:52.283455 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065875    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065878    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065882    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065885    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065889    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065893    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065896    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065900    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065904    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065908    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065912    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065915    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065919    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065923    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065926    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065930    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065935    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065939    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065943    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065948    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 02:44:52.305348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065951    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065955    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065959    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065962    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065966    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065969    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065973    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065977    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065980    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065984    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065987    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065991    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065995    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.065998    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066003    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066009    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066012    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066015    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066019    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066023    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 02:44:52.306211 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066027    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066031    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066037    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066041    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066045    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066048    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066052    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066055    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066060    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066064    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066068    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066074    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066077    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066080    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066084    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066088    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066094    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066099    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066103    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066106    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 02:44:52.306815 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066110    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066113    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066117    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066121    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066126    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066130    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066134    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066137    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066141    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066144    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066148    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066152    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066155    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066159    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066162    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066167    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066171    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 02:44:52.307442 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.066175    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.067006    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.073697    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.073711    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.073729    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.073738    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073792    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073797    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073800    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073803    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073805    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073808    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073811    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073814    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073816    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 02:44:52.308072 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073819    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073822    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073825    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073828    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073831    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073834    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073836    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073839    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073841    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073844    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073846    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073851    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073855    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073858    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073861    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073864    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073867    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073869    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073872    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 02:44:52.308888 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073874    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073877    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073880    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073883    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073885    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073888    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073890    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073893    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073895    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073898    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073900    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073902    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073905    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073907    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073910    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073912    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073915    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073917    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073923    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073926    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 02:44:52.309510 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073929    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073931    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073934    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073936    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073939    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073941    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073944    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073946    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073949    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073952    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073954    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073957    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073959    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073962    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073965    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073968    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073970    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073972    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073975    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073978    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 02:44:52.310136 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073980    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073982    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073986    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073990    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073993    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073996    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.073998    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074001    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074003    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074006    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074009    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074012    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074014    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074017    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074019    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074023    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074025    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074028    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074030    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 02:44:52.310992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074033    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074036    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074038    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074041    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074043    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074046    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074048    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074051    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074054    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074056    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074059    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074061    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.074066    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074168    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074173    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 02:44:52.311539 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074177    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074179    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074182    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074185    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074189    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074191    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074194    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074197    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074203    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074205    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074208    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074210    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074213    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074215    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074219    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074222    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074225    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074227    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074230    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074232    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 02:44:52.312049 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074235    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074237    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074239    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074243    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074247    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074250    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074253    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074256    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074259    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074262    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074265    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074267    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074270    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074272    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074275    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074277    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074280    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074282    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074285    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 02:44:52.312599 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074287    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074291    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074293    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074296    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074298    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074301    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074303    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074306    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074309    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074311    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074314    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074316    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074319    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074321    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074324    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074326    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074329    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074331    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074334    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074336    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 02:44:52.313178 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074339    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074342    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074344    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074346    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074349    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074352    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074354    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074356    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074359    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074361    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074364    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074366    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074368    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074372    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074374    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074376    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074379    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074382    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074384    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074388    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 02:44:52.313723 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074390    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074393    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074396    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074398    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074400    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074404    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074407    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074410    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074413    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074416    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074418    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074422    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074425    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074428    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074431    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074433    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074436    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 02:44:52.314282 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:52.074439    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.074444    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.074535    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.077329    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.078681    2584 server.go:1019] "Starting client certificate rotation"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.078782    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.078818    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.081155    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.082219    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.091736    2584 log.go:25] "Validated CRI v1 runtime API"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.093809    2584 log.go:25] "Validated CRI v1 image API"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.094593    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 02:44:52.314749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.097466    2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b5539c55-1c55-4781-8aaf-d8d967771821:/dev/nvme0n1p3 ee0d647c-f90d-4864-8667-705813f978b0:/dev/nvme0n1p4]
Jul 20 02:44:52.315123 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.097534    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 02:44:52.315194 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.104080    2584 manager.go:216] Machine: {Timestamp:2026-07-20 02:44:52.10267558 +0000 UTC m=+0.329444275 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3165933 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25595dab5c4ddd12c30d0ad194cafb SystemUUID:ec25595d-ab5c-4ddd-12c3-0d0ad194cafb BootID:13392ab7-cfea-45ff-a03e-4884ac30d7b5 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6a:4e:e0:0b:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6a:4e:e0:0b:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:72:75:c5:27:dc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 02:44:52.315194 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.104208    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 02:44:52.315194 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.104302    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 02:44:52.315194 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.107221    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 02:44:52.315194 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.107243    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-191.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 02:44:52.315194 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.107901    2584 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 02:44:52.315194 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.107913    2584 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 02:44:52.315194 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.107921    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.108702    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.109857    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.111904    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.114106    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.114207    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.114231    2584 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.114239    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.114256    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.114264    2584 kubelet.go:398] "Adding apiserver pod source"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.114273    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.114608    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.114626    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.116927    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.118451    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.118477    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119246    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119259    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119265    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119270    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119277    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119283    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119291    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119296    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119302    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119307    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119316    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.119321    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.120864    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.120877    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.126552    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.126744    2584 server.go:1268] "Started kubelet"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.126741    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.126783    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.126809    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-191.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.126844    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.126887    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.128042    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 02:44:52.315501 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.129317    2584 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.131877    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-191.ec2.internal.18c3df62a4626052  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-191.ec2.internal,UID:ip-10-0-140-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-191.ec2.internal,},FirstTimestamp:2026-07-20 02:44:52.12654805 +0000 UTC m=+0.353316740,LastTimestamp:2026-07-20 02:44:52.12654805 +0000 UTC m=+0.353316740,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-191.ec2.internal,}"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.135379    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.136550    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.136553    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.136675    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137542    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137557    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137596    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137676    2584 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137711    2584 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137781    2584 factory.go:153] Registering CRI-O factory
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137796    2584 factory.go:223] Registration of the crio container factory successfully
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137838    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137845    2584 factory.go:55] Registering systemd factory
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137851    2584 factory.go:223] Registration of the systemd container factory successfully
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137872    2584 factory.go:103] Registering Raw factory
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.137884    2584 manager.go:1196] Started watching for new ooms in manager
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.138480    2584 manager.go:349] Starting recovery of all containers
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.142519    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.142928    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.148715    2584 manager.go:354] Recovery completed
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.152533    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.154556    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.154590    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.154603    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientPID"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.155020    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.155027    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.155041    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.155066    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.155880    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.155905    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 02:44:52.317028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.155930    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientPID"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.156191    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-191.ec2.internal.18c3df62a60e0ee6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-191.ec2.internal,UID:ip-10-0-140-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-191.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-191.ec2.internal,},FirstTimestamp:2026-07-20 02:44:52.154576614 +0000 UTC m=+0.381345304,LastTimestamp:2026-07-20 02:44:52.154576614 +0000 UTC m=+0.381345304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-191.ec2.internal,}"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.157475    2584 policy_none.go:49] "None policy: Start"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.157487    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.157497    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.159703    2584 policy_none.go:47] "Start"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.161102    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhc5t"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.166177    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-191.ec2.internal.18c3df62a60e5d1e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-191.ec2.internal,UID:ip-10-0-140-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-191.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-191.ec2.internal,},FirstTimestamp:2026-07-20 02:44:52.154596638 +0000 UTC m=+0.381365329,LastTimestamp:2026-07-20 02:44:52.154596638 +0000 UTC m=+0.381365329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-191.ec2.internal,}"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.166605    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhc5t"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.209251    2584 manager.go:337] "Starting Device Plugin manager"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.209448    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.209460    2584 server.go:87] "Starting device plugin registration server"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.209709    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.209723    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.209815    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.209892    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.209902    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.211834    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.211876    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.271629    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.272800    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.272834    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.272856    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.272890    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.275696    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.309797    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.310659    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 02:44:52.317938 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.310694    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.310709    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientPID"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.310740    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.320235    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.320254    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-191.ec2.internal\": node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.342446    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.373250    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal"]
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.373311    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.374174    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.374201    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.374214    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientPID"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.376326    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.376450    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.376481    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.377118    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.377136    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.377144    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientPID"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.377326    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.377336    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.377344    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientPID"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.379367    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.379387    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.380157    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.380177    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 02:44:52.415790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.380189    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientPID"
Jul 20 02:44:52.416795 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.415980    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-191.ec2.internal\" not found" node="ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.528799 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.419541    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-191.ec2.internal\" not found" node="ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.528799 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.442799    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.538937    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5940e4bee1f971108f9452c22f76a23d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal\" (UID: \"5940e4bee1f971108f9452c22f76a23d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.538967    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5940e4bee1f971108f9452c22f76a23d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal\" (UID: \"5940e4bee1f971108f9452c22f76a23d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.538984    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ab3262203e6413ceb558164a98b82dd-config\") pod \"kube-apiserver-proxy-ip-10-0-140-191.ec2.internal\" (UID: \"8ab3262203e6413ceb558164a98b82dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.543003    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.639617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ab3262203e6413ceb558164a98b82dd-config\") pod \"kube-apiserver-proxy-ip-10-0-140-191.ec2.internal\" (UID: \"8ab3262203e6413ceb558164a98b82dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.639687    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5940e4bee1f971108f9452c22f76a23d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal\" (UID: \"5940e4bee1f971108f9452c22f76a23d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.639718    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5940e4bee1f971108f9452c22f76a23d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal\" (UID: \"5940e4bee1f971108f9452c22f76a23d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.639785    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5940e4bee1f971108f9452c22f76a23d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal\" (UID: \"5940e4bee1f971108f9452c22f76a23d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.639840    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ab3262203e6413ceb558164a98b82dd-config\") pod \"kube-apiserver-proxy-ip-10-0-140-191.ec2.internal\" (UID: \"8ab3262203e6413ceb558164a98b82dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.640675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.639871    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5940e4bee1f971108f9452c22f76a23d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal\" (UID: \"5940e4bee1f971108f9452c22f76a23d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.645063 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.643739    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:52.735975 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.722668    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.736460 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:52.736340    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:52.894596 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.744687    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:52.894596 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.844941    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:53.031064 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:52.945953    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:53.031064 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.006078    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 02:44:53.179573 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:53.046442    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:53.179573 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.080125    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 02:44:53.179573 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.080251    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 02:44:53.179573 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.080289    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 02:44:53.179573 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:53.146909    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:53.179573 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.175265    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 02:39:53 +0000 UTC" deadline="2028-02-09 07:14:34.764668608 +0000 UTC"
Jul 20 02:44:53.179573 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.175295    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13660h29m41.589377921s"
Jul 20 02:44:53.289849 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:53.247941    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:53.409476 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.336334    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 02:44:53.409476 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.337476    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 02:44:53.409476 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.337516    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 02:44:53.409476 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.337534    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeHasSufficientPID"
Jul 20 02:44:53.409476 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:53.348954    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:53.409476 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.397981    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 02:44:53.530616 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:53.449401    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-191.ec2.internal\" not found"
Jul 20 02:44:53.530616 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.492622    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 02:44:53.543683 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.537747    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:53.553909 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.551728    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 02:44:53.553909 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.553367    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal"
Jul 20 02:44:53.661807 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:53.563154    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 02:44:54.117212 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.117142    2584 apiserver.go:52] "Watching apiserver"
Jul 20 02:44:54.126198 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.126174    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 02:44:54.128244 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.128217    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-mbjmw","openshift-ovn-kubernetes/ovnkube-node-drpnm","kube-system/global-pull-secret-syncer-6xhcn","kube-system/konnectivity-agent-7rvrp","kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal","openshift-cluster-node-tuning-operator/tuned-99bq9","openshift-dns/node-resolver-vpdbw","openshift-image-registry/node-ca-kv9sm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal","openshift-multus/multus-additional-cni-plugins-64t7m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6","openshift-multus/multus-kjs8w","openshift-multus/network-metrics-daemon-284dq","openshift-network-diagnostics/network-check-target-8jw6m"]
Jul 20 02:44:54.130694 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.130664    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.132649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.132630    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 02:44:54.132773 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.132756    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8hgtf\""
Jul 20 02:44:54.132870 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.132860    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 02:44:54.133470 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.133457    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.135010 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.134980    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 02:44:54.135010 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.135002    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 02:44:54.135158 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.135084    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ttgmd\""
Jul 20 02:44:54.135222 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.135194    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 02:44:54.135948 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.135934    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.136016 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.136000    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:44:54.137821 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.137806    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 02:44:54.138361 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.138320    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:44:54.140215 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.140190    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 02:44:54.140401 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.140383    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qvv76\""
Jul 20 02:44:54.140493 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.140387    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 02:44:54.140613 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.140599    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:44:54.140688 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.140671    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:44:54.142791 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.142775    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.144484 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.144456    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 02:44:54.144484 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.144480    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 02:44:54.144601 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.144558    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-99tmw\""
Jul 20 02:44:54.145368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.145349    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.146826 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.146807    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 02:44:54.147124 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.147109    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 02:44:54.147228 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.147156    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 02:44:54.147228 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.147112    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qzrcz\""
Jul 20 02:44:54.147340 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.147267    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 02:44:54.147744 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.147727    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:54.147868 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.147788    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:44:54.149486 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.149468    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.150449 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150432    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.150540 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4369624d-875b-416a-927a-80928ed35f04-dbus\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.150540 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150471    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-socket-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.150540 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150490    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjqx\" (UniqueName: \"kubernetes.io/projected/225e9e97-1891-45b6-a07c-9757e8e87138-kube-api-access-pjjqx\") pod \"node-resolver-vpdbw\" (UID: \"225e9e97-1891-45b6-a07c-9757e8e87138\") " pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.150540 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150515    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-device-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.150678 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150589    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.150678 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150624    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-registration-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.150678 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150652    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.150801 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150673    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8f8406a-9cb8-4430-a338-4d5400caa917-agent-certs\") pod \"konnectivity-agent-7rvrp\" (UID: \"f8f8406a-9cb8-4430-a338-4d5400caa917\") " pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:44:54.150801 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8f8406a-9cb8-4430-a338-4d5400caa917-konnectivity-ca\") pod \"konnectivity-agent-7rvrp\" (UID: \"f8f8406a-9cb8-4430-a338-4d5400caa917\") " pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:44:54.150801 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150763    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-sys-fs\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.151009 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl2tn\" (UniqueName: \"kubernetes.io/projected/801028ab-5ea4-484c-9861-2c003d1082a1-kube-api-access-nl2tn\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.151009 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150835    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4369624d-875b-416a-927a-80928ed35f04-kubelet-config\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.151009 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150864    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/225e9e97-1891-45b6-a07c-9757e8e87138-hosts-file\") pod \"node-resolver-vpdbw\" (UID: \"225e9e97-1891-45b6-a07c-9757e8e87138\") " pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.151009 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.150888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/225e9e97-1891-45b6-a07c-9757e8e87138-tmp-dir\") pod \"node-resolver-vpdbw\" (UID: \"225e9e97-1891-45b6-a07c-9757e8e87138\") " pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.151880 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.151857    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 02:44:54.151977 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.151893    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vpwgg\""
Jul 20 02:44:54.151977 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.151905    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 02:44:54.152098 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.152067    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 02:44:54.152225 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.152193    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 02:44:54.152360 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.152345    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.152796 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.152781    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 02:44:54.152872 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.152810    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 02:44:54.154412 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.154397    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 02:44:54.154497 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.154481    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 02:44:54.155356 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.155337    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 02:44:54.155473 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.155372    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qzlwp\""
Jul 20 02:44:54.155473 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.155429    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 02:44:54.155599 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.155496    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.155659 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.155501    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 02:44:54.157196 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.157179    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 02:44:54.157419 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.157362    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zb46q\""
Jul 20 02:44:54.157476 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.157429    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 02:44:54.157476 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.157440    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 02:44:54.159891 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.158801    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.160697 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.160677    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 02:44:54.161260 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.161235    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2bvlw\""
Jul 20 02:44:54.171263 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.171245    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qq9zw"
Jul 20 02:44:54.176962 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.176946    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qq9zw"
Jul 20 02:44:54.238815 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.238791    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 02:44:54.251835 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.251812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8f8406a-9cb8-4430-a338-4d5400caa917-agent-certs\") pod \"konnectivity-agent-7rvrp\" (UID: \"f8f8406a-9cb8-4430-a338-4d5400caa917\") " pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:44:54.251945 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.251851    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9m5b\" (UniqueName: \"kubernetes.io/projected/6fb1844f-0bb1-4982-b830-39500f72b0ef-kube-api-access-l9m5b\") pod \"node-ca-kv9sm\" (UID: \"6fb1844f-0bb1-4982-b830-39500f72b0ef\") " pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.251945 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.251874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpwws\" (UniqueName: \"kubernetes.io/projected/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-kube-api-access-xpwws\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.251945 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.251890    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-system-cni-dir\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.251945 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.251914    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fb1844f-0bb1-4982-b830-39500f72b0ef-serviceca\") pod \"node-ca-kv9sm\" (UID: \"6fb1844f-0bb1-4982-b830-39500f72b0ef\") " pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.252096 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.251957    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f64af5e-79bf-454e-b1df-43637e20ae8c-tmp\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.252096 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.251981    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-run-ovn\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.252096 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252004    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-cni-bin\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.252096 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252031    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-socket-dir-parent\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.252096 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.252096 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252082    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjjqx\" (UniqueName: \"kubernetes.io/projected/225e9e97-1891-45b6-a07c-9757e8e87138-kube-api-access-pjjqx\") pod \"node-resolver-vpdbw\" (UID: \"225e9e97-1891-45b6-a07c-9757e8e87138\") " pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.252320 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252115    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-host\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.252320 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-run-openvswitch\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.252320 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252258    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 02:44:54.252320 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252280    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-sysctl-conf\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.252470 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252333    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-ovnkube-config\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.252470 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252354    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-system-cni-dir\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.252470 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252374    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-hostroot\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.252470 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252411    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-modprobe-d\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.252470 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252434    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-sysctl-d\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.252470 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4369624d-875b-416a-927a-80928ed35f04-kubelet-config\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252484    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-var-lib-openvswitch\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-ovnkube-script-lib\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252533    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-cnibin\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252539    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4369624d-875b-416a-927a-80928ed35f04-kubelet-config\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252557    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-os-release\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252594    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252614    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-socket-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252673    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-sysconfig\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252702    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcmp\" (UniqueName: \"kubernetes.io/projected/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-kube-api-access-pwcmp\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252728    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a002f6d-7f30-4bf4-95e1-28639716d110-iptables-alerter-script\") pod \"iptables-alerter-mbjmw\" (UID: \"2a002f6d-7f30-4bf4-95e1-28639716d110\") " pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.252703 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252753    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-socket-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252778    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-conf-dir\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-device-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252862    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fb1844f-0bb1-4982-b830-39500f72b0ef-host\") pod \"node-ca-kv9sm\" (UID: \"6fb1844f-0bb1-4982-b830-39500f72b0ef\") " pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252889    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252915    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-cni-dir\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-device-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252941    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-ovn-node-metrics-cert\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252968    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-registration-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.252994    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8f8406a-9cb8-4430-a338-4d5400caa917-konnectivity-ca\") pod \"konnectivity-agent-7rvrp\" (UID: \"f8f8406a-9cb8-4430-a338-4d5400caa917\") " pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253020    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-systemd\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253050    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-registration-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253165    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.253310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253198    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-var-lib-cni-multus\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-etc-kubernetes\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcgz4\" (UniqueName: \"kubernetes.io/projected/9788e27f-288e-4bf0-99ce-aa3440d843a5-kube-api-access-dcgz4\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253278    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-sys-fs\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2tn\" (UniqueName: \"kubernetes.io/projected/801028ab-5ea4-484c-9861-2c003d1082a1-kube-api-access-nl2tn\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253341    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253355    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-sys-fs\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253485    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253372    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4369624d-875b-416a-927a-80928ed35f04-dbus\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253526    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4369624d-875b-416a-927a-80928ed35f04-dbus\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-tuned\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253541    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8f8406a-9cb8-4430-a338-4d5400caa917-konnectivity-ca\") pod \"konnectivity-agent-7rvrp\" (UID: \"f8f8406a-9cb8-4430-a338-4d5400caa917\") " pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253571    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a002f6d-7f30-4bf4-95e1-28639716d110-host-slash\") pod \"iptables-alerter-mbjmw\" (UID: \"2a002f6d-7f30-4bf4-95e1-28639716d110\") " pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.253972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-lib-modules\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-etc-openvswitch\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-var-lib-cni-bin\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253643    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-var-lib-kubelet\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253658    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-run-multus-certs\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253686    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24zn6\" (UniqueName: \"kubernetes.io/projected/ed646a9b-9280-4d49-bd09-125c0e528da7-kube-api-access-24zn6\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253730    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-kubernetes\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253746    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-node-log\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253760    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-cni-netd\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253781    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253829    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk2x7\" (UniqueName: \"kubernetes.io/projected/2a002f6d-7f30-4bf4-95e1-28639716d110-kube-api-access-kk2x7\") pod \"iptables-alerter-mbjmw\" (UID: \"2a002f6d-7f30-4bf4-95e1-28639716d110\") " pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253847    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-cnibin\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253866    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed646a9b-9280-4d49-bd09-125c0e528da7-cni-binary-copy\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.254570 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253913    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253929    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-log-socket\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253948    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-run-netns\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253970    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/801028ab-5ea4-484c-9861-2c003d1082a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.253970    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-env-overrides\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254011    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/225e9e97-1891-45b6-a07c-9757e8e87138-hosts-file\") pod \"node-resolver-vpdbw\" (UID: \"225e9e97-1891-45b6-a07c-9757e8e87138\") " pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.254017    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254034    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/225e9e97-1891-45b6-a07c-9757e8e87138-tmp-dir\") pod \"node-resolver-vpdbw\" (UID: \"225e9e97-1891-45b6-a07c-9757e8e87138\") " pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254058    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv784\" (UniqueName: \"kubernetes.io/projected/3f64af5e-79bf-454e-b1df-43637e20ae8c-kube-api-access-lv784\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.254105    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret podName:4369624d-875b-416a-927a-80928ed35f04 nodeName:}" failed. No retries permitted until 2026-07-20 02:44:54.754071114 +0000 UTC m=+2.980839803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret") pod "global-pull-secret-syncer-6xhcn" (UID: "4369624d-875b-416a-927a-80928ed35f04") : object "kube-system"/"original-pull-secret" not registered
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/225e9e97-1891-45b6-a07c-9757e8e87138-hosts-file\") pod \"node-resolver-vpdbw\" (UID: \"225e9e97-1891-45b6-a07c-9757e8e87138\") " pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254129    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-kubelet\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-daemon-config\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254188    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-run\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.255007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254215    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.255512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-os-release\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.255512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-sys\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.255512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254298    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-var-lib-kubelet\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.255512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254321    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-systemd-units\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.255512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254329    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/225e9e97-1891-45b6-a07c-9757e8e87138-tmp-dir\") pod \"node-resolver-vpdbw\" (UID: \"225e9e97-1891-45b6-a07c-9757e8e87138\") " pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.255512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-slash\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.255512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-run-netns\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.255512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254398    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-run-systemd\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.255512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.254422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-run-k8s-cni-cncf-io\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.255984 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.255967    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8f8406a-9cb8-4430-a338-4d5400caa917-agent-certs\") pod \"konnectivity-agent-7rvrp\" (UID: \"f8f8406a-9cb8-4430-a338-4d5400caa917\") " pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:44:54.263351 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.263327    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjjqx\" (UniqueName: \"kubernetes.io/projected/225e9e97-1891-45b6-a07c-9757e8e87138-kube-api-access-pjjqx\") pod \"node-resolver-vpdbw\" (UID: \"225e9e97-1891-45b6-a07c-9757e8e87138\") " pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.263913 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.263895    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl2tn\" (UniqueName: \"kubernetes.io/projected/801028ab-5ea4-484c-9861-2c003d1082a1-kube-api-access-nl2tn\") pod \"aws-ebs-csi-driver-node-445n6\" (UID: \"801028ab-5ea4-484c-9861-2c003d1082a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.309183 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.309154    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5940e4bee1f971108f9452c22f76a23d.slice/crio-fd4c13750ec0f688a4ca0034dc9b41ed728b3d679c4fbbac8edfff27ca0d1131 WatchSource:0}: Error finding container fd4c13750ec0f688a4ca0034dc9b41ed728b3d679c4fbbac8edfff27ca0d1131: Status 404 returned error can't find the container with id fd4c13750ec0f688a4ca0034dc9b41ed728b3d679c4fbbac8edfff27ca0d1131
Jul 20 02:44:54.309871 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.309852    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab3262203e6413ceb558164a98b82dd.slice/crio-e88e86c90029be5a89fe994081ac4c24c30d3cb3962e1545d547f8fb4bf06c7c WatchSource:0}: Error finding container e88e86c90029be5a89fe994081ac4c24c30d3cb3962e1545d547f8fb4bf06c7c: Status 404 returned error can't find the container with id e88e86c90029be5a89fe994081ac4c24c30d3cb3962e1545d547f8fb4bf06c7c
Jul 20 02:44:54.315430 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.315413    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 02:44:54.355315 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355288    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-host\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-run-openvswitch\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355338    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-sysctl-conf\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355353    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-ovnkube-config\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355371    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-system-cni-dir\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355386    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-hostroot\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355400    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-modprobe-d\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355401    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-run-openvswitch\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-sysctl-d\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355444    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-var-lib-openvswitch\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355455    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-hostroot\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.355483 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355474    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-ovnkube-script-lib\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-system-cni-dir\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355499    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-cnibin\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355508    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-sysctl-conf\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355522    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-os-release\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355517    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-host\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355544    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-var-lib-openvswitch\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355561    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355571    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-cnibin\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355572    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-sysctl-d\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-sysconfig\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355624    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcmp\" (UniqueName: \"kubernetes.io/projected/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-kube-api-access-pwcmp\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355652    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a002f6d-7f30-4bf4-95e1-28639716d110-iptables-alerter-script\") pod \"iptables-alerter-mbjmw\" (UID: \"2a002f6d-7f30-4bf4-95e1-28639716d110\") " pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355681    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-sysconfig\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.356165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355697    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-conf-dir\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355723    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fb1844f-0bb1-4982-b830-39500f72b0ef-host\") pod \"node-ca-kv9sm\" (UID: \"6fb1844f-0bb1-4982-b830-39500f72b0ef\") " pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355725    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-os-release\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355760    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355784    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-conf-dir\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-cni-dir\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355828    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fb1844f-0bb1-4982-b830-39500f72b0ef-host\") pod \"node-ca-kv9sm\" (UID: \"6fb1844f-0bb1-4982-b830-39500f72b0ef\") " pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-ovn-node-metrics-cert\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355865    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355885    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-cni-dir\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355893    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-systemd\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355920    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355947    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-var-lib-cni-multus\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.355967    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:44:54.356902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355970    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-etc-kubernetes\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.355997    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgz4\" (UniqueName: \"kubernetes.io/projected/9788e27f-288e-4bf0-99ce-aa3440d843a5-kube-api-access-dcgz4\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356008    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-systemd\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.356034    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:44:54.856013571 +0000 UTC m=+3.082782264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356060    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-var-lib-cni-multus\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356076    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-etc-kubernetes\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356126    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-tuned\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356128    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-ovnkube-script-lib\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356156    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-ovnkube-config\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a002f6d-7f30-4bf4-95e1-28639716d110-host-slash\") pod \"iptables-alerter-mbjmw\" (UID: \"2a002f6d-7f30-4bf4-95e1-28639716d110\") " pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-lib-modules\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356229    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-etc-openvswitch\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356248    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-modprobe-d\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.357649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356255    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-var-lib-cni-bin\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356306    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-var-lib-cni-bin\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-var-lib-kubelet\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-etc-openvswitch\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356360    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-var-lib-kubelet\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356384    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-run-multus-certs\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356402    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a002f6d-7f30-4bf4-95e1-28639716d110-host-slash\") pod \"iptables-alerter-mbjmw\" (UID: \"2a002f6d-7f30-4bf4-95e1-28639716d110\") " pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356410    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24zn6\" (UniqueName: \"kubernetes.io/projected/ed646a9b-9280-4d49-bd09-125c0e528da7-kube-api-access-24zn6\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356430    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-lib-modules\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356440    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-run-multus-certs\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356434    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-kubernetes\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-kubernetes\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356493    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-node-log\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-cni-netd\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356566    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-node-log\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356586    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk2x7\" (UniqueName: \"kubernetes.io/projected/2a002f6d-7f30-4bf4-95e1-28639716d110-kube-api-access-kk2x7\") pod \"iptables-alerter-mbjmw\" (UID: \"2a002f6d-7f30-4bf4-95e1-28639716d110\") " pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356611    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-cnibin\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356623    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356642    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed646a9b-9280-4d49-bd09-125c0e528da7-cni-binary-copy\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356658    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356695    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-cnibin\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356707    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-cni-netd\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356709    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-log-socket\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356809    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-log-socket\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-run-netns\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356864    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-env-overrides\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv784\" (UniqueName: \"kubernetes.io/projected/3f64af5e-79bf-454e-b1df-43637e20ae8c-kube-api-access-lv784\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356918    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-kubelet\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-run-netns\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.358846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-daemon-config\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356974    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-kubelet\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.356992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-run\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357053    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-os-release\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357054    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357078    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-sys\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-var-lib-kubelet\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357136    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-systemd-units\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357162    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-slash\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357187    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-run-netns\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-run-systemd\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-run-k8s-cni-cncf-io\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357268    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9m5b\" (UniqueName: \"kubernetes.io/projected/6fb1844f-0bb1-4982-b830-39500f72b0ef-kube-api-access-l9m5b\") pod \"node-ca-kv9sm\" (UID: \"6fb1844f-0bb1-4982-b830-39500f72b0ef\") " pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357280    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-env-overrides\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359366 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357295    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpwws\" (UniqueName: \"kubernetes.io/projected/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-kube-api-access-xpwws\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-system-cni-dir\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-system-cni-dir\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357461    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-os-release\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fb1844f-0bb1-4982-b830-39500f72b0ef-serviceca\") pod \"node-ca-kv9sm\" (UID: \"6fb1844f-0bb1-4982-b830-39500f72b0ef\") " pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357498    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f64af5e-79bf-454e-b1df-43637e20ae8c-tmp\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357550    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-run-ovn\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357586    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-cni-bin\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357574    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-run\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357612    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-socket-dir-parent\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357616    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-run-systemd\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357653    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357670    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-host-run-k8s-cni-cncf-io\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357675    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-var-lib-kubelet\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.359926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357711    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-systemd-units\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357515    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-daemon-config\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357740    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed646a9b-9280-4d49-bd09-125c0e528da7-multus-socket-dir-parent\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357772    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fb1844f-0bb1-4982-b830-39500f72b0ef-serviceca\") pod \"node-ca-kv9sm\" (UID: \"6fb1844f-0bb1-4982-b830-39500f72b0ef\") " pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357784    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f64af5e-79bf-454e-b1df-43637e20ae8c-sys\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357792    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-run-ovn\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357805    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-slash\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357874    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a002f6d-7f30-4bf4-95e1-28639716d110-iptables-alerter-script\") pod \"iptables-alerter-mbjmw\" (UID: \"2a002f6d-7f30-4bf4-95e1-28639716d110\") " pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357919    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-run-netns\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357927    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-cni-bin\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.357959    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.358092    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed646a9b-9280-4d49-bd09-125c0e528da7-cni-binary-copy\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.358634    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f64af5e-79bf-454e-b1df-43637e20ae8c-etc-tuned\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.358646    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-ovn-node-metrics-cert\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.360368 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.359635    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f64af5e-79bf-454e-b1df-43637e20ae8c-tmp\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.362528 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.362510    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 02:44:54.362576 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.362533    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 02:44:54.362576 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.362546    2584 projected.go:196] Error preparing data for projected volume kube-api-access-s6ch5 for pod openshift-network-diagnostics/network-check-target-8jw6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:44:54.362639 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.362615    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5 podName:5b0798ce-b392-4f05-8582-f1f9ead610f7 nodeName:}" failed. No retries permitted until 2026-07-20 02:44:54.862598701 +0000 UTC m=+3.089367395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s6ch5" (UniqueName: "kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5") pod "network-check-target-8jw6m" (UID: "5b0798ce-b392-4f05-8582-f1f9ead610f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:44:54.365111 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.365085    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgz4\" (UniqueName: \"kubernetes.io/projected/9788e27f-288e-4bf0-99ce-aa3440d843a5-kube-api-access-dcgz4\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:54.365251 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.365235    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9m5b\" (UniqueName: \"kubernetes.io/projected/6fb1844f-0bb1-4982-b830-39500f72b0ef-kube-api-access-l9m5b\") pod \"node-ca-kv9sm\" (UID: \"6fb1844f-0bb1-4982-b830-39500f72b0ef\") " pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.365894 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.365870    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcmp\" (UniqueName: \"kubernetes.io/projected/e97a520a-d34e-48b1-bfc3-e4ad68daab2f-kube-api-access-pwcmp\") pod \"multus-additional-cni-plugins-64t7m\" (UID: \"e97a520a-d34e-48b1-bfc3-e4ad68daab2f\") " pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.365894 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.365882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24zn6\" (UniqueName: \"kubernetes.io/projected/ed646a9b-9280-4d49-bd09-125c0e528da7-kube-api-access-24zn6\") pod \"multus-kjs8w\" (UID: \"ed646a9b-9280-4d49-bd09-125c0e528da7\") " pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.366035 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.365946    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv784\" (UniqueName: \"kubernetes.io/projected/3f64af5e-79bf-454e-b1df-43637e20ae8c-kube-api-access-lv784\") pod \"tuned-99bq9\" (UID: \"3f64af5e-79bf-454e-b1df-43637e20ae8c\") " pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.366405 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.366378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpwws\" (UniqueName: \"kubernetes.io/projected/c28062c6-fd4b-4d1c-9f84-fec38088ea7c-kube-api-access-xpwws\") pod \"ovnkube-node-drpnm\" (UID: \"c28062c6-fd4b-4d1c-9f84-fec38088ea7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.366503 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.366489    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk2x7\" (UniqueName: \"kubernetes.io/projected/2a002f6d-7f30-4bf4-95e1-28639716d110-kube-api-access-kk2x7\") pod \"iptables-alerter-mbjmw\" (UID: \"2a002f6d-7f30-4bf4-95e1-28639716d110\") " pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.452238 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.452154    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vpdbw"
Jul 20 02:44:54.463224 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.463196    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225e9e97_1891_45b6_a07c_9757e8e87138.slice/crio-20d3377fbffc20631f67133483841921bed0ec19c9ee76f2b16383d487314048 WatchSource:0}: Error finding container 20d3377fbffc20631f67133483841921bed0ec19c9ee76f2b16383d487314048: Status 404 returned error can't find the container with id 20d3377fbffc20631f67133483841921bed0ec19c9ee76f2b16383d487314048
Jul 20 02:44:54.463925 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.463903    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6"
Jul 20 02:44:54.472411 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.472391    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:44:54.473088 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.473066    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801028ab_5ea4_484c_9861_2c003d1082a1.slice/crio-73de6b2f459fc89b4e0f0454afeb5fd6a5449cc859bea8b453155287ec968379 WatchSource:0}: Error finding container 73de6b2f459fc89b4e0f0454afeb5fd6a5449cc859bea8b453155287ec968379: Status 404 returned error can't find the container with id 73de6b2f459fc89b4e0f0454afeb5fd6a5449cc859bea8b453155287ec968379
Jul 20 02:44:54.480798 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.480772    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f8406a_9cb8_4430_a338_4d5400caa917.slice/crio-c4470e4d333e36a69b1e6cc33f8bcb863a6788ec5ff04164103f3f2550d97e94 WatchSource:0}: Error finding container c4470e4d333e36a69b1e6cc33f8bcb863a6788ec5ff04164103f3f2550d97e94: Status 404 returned error can't find the container with id c4470e4d333e36a69b1e6cc33f8bcb863a6788ec5ff04164103f3f2550d97e94
Jul 20 02:44:54.496654 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.496612    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99bq9"
Jul 20 02:44:54.517613 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.517594    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kv9sm"
Jul 20 02:44:54.526183 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.526163    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb1844f_0bb1_4982_b830_39500f72b0ef.slice/crio-d939aaaff726d3247ddedab9ca2449c4da7dfc1c56d0768fb9bd6af6eb21f4ce WatchSource:0}: Error finding container d939aaaff726d3247ddedab9ca2449c4da7dfc1c56d0768fb9bd6af6eb21f4ce: Status 404 returned error can't find the container with id d939aaaff726d3247ddedab9ca2449c4da7dfc1c56d0768fb9bd6af6eb21f4ce
Jul 20 02:44:54.530202 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.530185    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:44:54.538348 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.538327    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28062c6_fd4b_4d1c_9f84_fec38088ea7c.slice/crio-a3009b39392d797c0d75981030ba1a72a5dc34388e8e6488e7f6cd0cb110a88d WatchSource:0}: Error finding container a3009b39392d797c0d75981030ba1a72a5dc34388e8e6488e7f6cd0cb110a88d: Status 404 returned error can't find the container with id a3009b39392d797c0d75981030ba1a72a5dc34388e8e6488e7f6cd0cb110a88d
Jul 20 02:44:54.541346 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.541291    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64t7m"
Jul 20 02:44:54.549363 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.549341    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97a520a_d34e_48b1_bfc3_e4ad68daab2f.slice/crio-291df43026fefbc8920e56e52528ac4d2d49ed668d94be3d5794966a0190f0ac WatchSource:0}: Error finding container 291df43026fefbc8920e56e52528ac4d2d49ed668d94be3d5794966a0190f0ac: Status 404 returned error can't find the container with id 291df43026fefbc8920e56e52528ac4d2d49ed668d94be3d5794966a0190f0ac
Jul 20 02:44:54.556447 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.556426    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mbjmw"
Jul 20 02:44:54.564674 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.564655    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kjs8w"
Jul 20 02:44:54.564983 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.564961    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a002f6d_7f30_4bf4_95e1_28639716d110.slice/crio-fa7d91d7d4af3a2e60f4ba0e027f7d78f4b39c99eb47438ef7126b410821a99d WatchSource:0}: Error finding container fa7d91d7d4af3a2e60f4ba0e027f7d78f4b39c99eb47438ef7126b410821a99d: Status 404 returned error can't find the container with id fa7d91d7d4af3a2e60f4ba0e027f7d78f4b39c99eb47438ef7126b410821a99d
Jul 20 02:44:54.574009 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:44:54.573991    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded646a9b_9280_4d49_bd09_125c0e528da7.slice/crio-8a4f425e90beb5aa5f994829d0b2a3620b998d697cb5f8304a9043818da1f002 WatchSource:0}: Error finding container 8a4f425e90beb5aa5f994829d0b2a3620b998d697cb5f8304a9043818da1f002: Status 404 returned error can't find the container with id 8a4f425e90beb5aa5f994829d0b2a3620b998d697cb5f8304a9043818da1f002
Jul 20 02:44:54.632527 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.632495    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 02:44:54.760657 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.760548    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:54.760814 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.760711    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 02:44:54.760814 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.760776    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret podName:4369624d-875b-416a-927a-80928ed35f04 nodeName:}" failed. No retries permitted until 2026-07-20 02:44:55.760758454 +0000 UTC m=+3.987527136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret") pod "global-pull-secret-syncer-6xhcn" (UID: "4369624d-875b-416a-927a-80928ed35f04") : object "kube-system"/"original-pull-secret" not registered
Jul 20 02:44:54.861609 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.861566    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:54.861795 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.861746    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:44:54.861841 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.861830    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:44:55.861812522 +0000 UTC m=+4.088581202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:44:54.962886 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:54.962851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:44:54.963099 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.963077    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 02:44:54.963162 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.963106    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 02:44:54.963162 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.963118    2584 projected.go:196] Error preparing data for projected volume kube-api-access-s6ch5 for pod openshift-network-diagnostics/network-check-target-8jw6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:44:54.963280 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:54.963181    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5 podName:5b0798ce-b392-4f05-8582-f1f9ead610f7 nodeName:}" failed. No retries permitted until 2026-07-20 02:44:55.963161906 +0000 UTC m=+4.189930591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6ch5" (UniqueName: "kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5") pod "network-check-target-8jw6m" (UID: "5b0798ce-b392-4f05-8582-f1f9ead610f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:44:55.180275 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.180159    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 02:39:54 +0000 UTC" deadline="2028-05-03 06:45:54.883811578 +0000 UTC"
Jul 20 02:44:55.180275 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.180206    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15676h0m59.703619253s"
Jul 20 02:44:55.294764 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.294685    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rvrp" event={"ID":"f8f8406a-9cb8-4430-a338-4d5400caa917","Type":"ContainerStarted","Data":"c4470e4d333e36a69b1e6cc33f8bcb863a6788ec5ff04164103f3f2550d97e94"}
Jul 20 02:44:55.307611 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.307370    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6" event={"ID":"801028ab-5ea4-484c-9861-2c003d1082a1","Type":"ContainerStarted","Data":"73de6b2f459fc89b4e0f0454afeb5fd6a5449cc859bea8b453155287ec968379"}
Jul 20 02:44:55.341438 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.341397    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal" event={"ID":"8ab3262203e6413ceb558164a98b82dd","Type":"ContainerStarted","Data":"e88e86c90029be5a89fe994081ac4c24c30d3cb3962e1545d547f8fb4bf06c7c"}
Jul 20 02:44:55.351338 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.351302    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kjs8w" event={"ID":"ed646a9b-9280-4d49-bd09-125c0e528da7","Type":"ContainerStarted","Data":"8a4f425e90beb5aa5f994829d0b2a3620b998d697cb5f8304a9043818da1f002"}
Jul 20 02:44:55.372038 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.371993    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mbjmw" event={"ID":"2a002f6d-7f30-4bf4-95e1-28639716d110","Type":"ContainerStarted","Data":"fa7d91d7d4af3a2e60f4ba0e027f7d78f4b39c99eb47438ef7126b410821a99d"}
Jul 20 02:44:55.399859 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.399826    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 02:44:55.403296 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.403243    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64t7m" event={"ID":"e97a520a-d34e-48b1-bfc3-e4ad68daab2f","Type":"ContainerStarted","Data":"291df43026fefbc8920e56e52528ac4d2d49ed668d94be3d5794966a0190f0ac"}
Jul 20 02:44:55.416278 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.416068    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerStarted","Data":"a3009b39392d797c0d75981030ba1a72a5dc34388e8e6488e7f6cd0cb110a88d"}
Jul 20 02:44:55.419209 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.419151    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kv9sm" event={"ID":"6fb1844f-0bb1-4982-b830-39500f72b0ef","Type":"ContainerStarted","Data":"d939aaaff726d3247ddedab9ca2449c4da7dfc1c56d0768fb9bd6af6eb21f4ce"}
Jul 20 02:44:55.454304 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.454168    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99bq9" event={"ID":"3f64af5e-79bf-454e-b1df-43637e20ae8c","Type":"ContainerStarted","Data":"ab18e3a5a84099bf4cd59772988c63924a95ccf528b4a65574caf1a5c4b4676b"}
Jul 20 02:44:55.469850 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.469812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vpdbw" event={"ID":"225e9e97-1891-45b6-a07c-9757e8e87138","Type":"ContainerStarted","Data":"20d3377fbffc20631f67133483841921bed0ec19c9ee76f2b16383d487314048"}
Jul 20 02:44:55.483315 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.483269    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal" event={"ID":"5940e4bee1f971108f9452c22f76a23d","Type":"ContainerStarted","Data":"fd4c13750ec0f688a4ca0034dc9b41ed728b3d679c4fbbac8edfff27ca0d1131"}
Jul 20 02:44:55.770848 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.770751    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:55.771025 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:55.770962    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 02:44:55.771097 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:55.771045    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret podName:4369624d-875b-416a-927a-80928ed35f04 nodeName:}" failed. No retries permitted until 2026-07-20 02:44:57.771022991 +0000 UTC m=+5.997791675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret") pod "global-pull-secret-syncer-6xhcn" (UID: "4369624d-875b-416a-927a-80928ed35f04") : object "kube-system"/"original-pull-secret" not registered
Jul 20 02:44:55.871837 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.871789    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:55.872037 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:55.871946    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:44:55.872037 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:55.872023    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:44:57.872002305 +0000 UTC m=+6.098770989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:44:55.972548 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:55.972478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:44:55.972788 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:55.972703    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 02:44:55.972788 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:55.972726    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 02:44:55.972788 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:55.972767    2584 projected.go:196] Error preparing data for projected volume kube-api-access-s6ch5 for pod openshift-network-diagnostics/network-check-target-8jw6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:44:55.972982 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:55.972836    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5 podName:5b0798ce-b392-4f05-8582-f1f9ead610f7 nodeName:}" failed. No retries permitted until 2026-07-20 02:44:57.972814639 +0000 UTC m=+6.199583322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6ch5" (UniqueName: "kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5") pod "network-check-target-8jw6m" (UID: "5b0798ce-b392-4f05-8582-f1f9ead610f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:44:56.181380 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:56.181233    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 02:39:54 +0000 UTC" deadline="2028-04-16 16:59:00.361596374 +0000 UTC"
Jul 20 02:44:56.181380 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:56.181357    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15278h14m4.180245367s"
Jul 20 02:44:56.280274 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:56.280209    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:56.280452 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:56.280368    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:44:56.281209 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:56.281191    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:44:56.281311 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:56.281290    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:44:56.281381 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:56.281364    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:56.281457 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:56.281439    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:44:57.792084 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:57.792041    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:57.792592 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:57.792213    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 02:44:57.792592 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:57.792281    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret podName:4369624d-875b-416a-927a-80928ed35f04 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:01.792259485 +0000 UTC m=+10.019028168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret") pod "global-pull-secret-syncer-6xhcn" (UID: "4369624d-875b-416a-927a-80928ed35f04") : object "kube-system"/"original-pull-secret" not registered
Jul 20 02:44:57.894170 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:57.893540    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:57.894170 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:57.893719    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:44:57.894170 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:57.893791    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:01.893767815 +0000 UTC m=+10.120536497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:44:57.995569 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:57.994876    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:44:57.995569 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:57.995096    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 02:44:57.995569 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:57.995122    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 02:44:57.995569 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:57.995138    2584 projected.go:196] Error preparing data for projected volume kube-api-access-s6ch5 for pod openshift-network-diagnostics/network-check-target-8jw6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:44:57.995569 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:57.995204    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5 podName:5b0798ce-b392-4f05-8582-f1f9ead610f7 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:01.995184732 +0000 UTC m=+10.221953415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6ch5" (UniqueName: "kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5") pod "network-check-target-8jw6m" (UID: "5b0798ce-b392-4f05-8582-f1f9ead610f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:44:58.274380 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:58.274264    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:44:58.274564 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:58.274420    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:44:58.274980 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:58.274763    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:44:58.274980 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:58.274883    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:44:58.274980 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:44:58.274924    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:44:58.275195 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:44:58.275021    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:00.273766 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:00.273711    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:00.274227 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:00.273711    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:00.274227 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:00.273844    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:00.274227 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:00.273967    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:00.274227 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:00.273838    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:00.274227 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:00.274012    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:01.828393 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:01.828337    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:01.828900 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:01.828540    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 02:45:01.828900 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:01.828635    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret podName:4369624d-875b-416a-927a-80928ed35f04 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:09.828611576 +0000 UTC m=+18.055380262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret") pod "global-pull-secret-syncer-6xhcn" (UID: "4369624d-875b-416a-927a-80928ed35f04") : object "kube-system"/"original-pull-secret" not registered
Jul 20 02:45:01.929841 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:01.929790    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:01.930042 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:01.929963    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:45:01.930106 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:01.930057    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:09.930032638 +0000 UTC m=+18.156801319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:45:02.031192 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:02.031147    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:02.031410 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:02.031389    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 02:45:02.031477 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:02.031418    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 02:45:02.031477 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:02.031433    2584 projected.go:196] Error preparing data for projected volume kube-api-access-s6ch5 for pod openshift-network-diagnostics/network-check-target-8jw6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:45:02.031584 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:02.031505    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5 podName:5b0798ce-b392-4f05-8582-f1f9ead610f7 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:10.031484551 +0000 UTC m=+18.258253234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6ch5" (UniqueName: "kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5") pod "network-check-target-8jw6m" (UID: "5b0798ce-b392-4f05-8582-f1f9ead610f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:45:02.275051 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:02.274175    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:02.275051 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:02.274320    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:02.275051 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:02.274689    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:02.275051 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:02.274822    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:02.275051 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:02.274886    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:02.275051 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:02.274959    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:04.276106 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:04.275522    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:04.276106 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:04.275747    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:04.276106 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:04.275820    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:04.276106 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:04.275918    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:04.276106 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:04.275962    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:04.276106 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:04.276029    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:06.273292 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:06.273255    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:06.273746 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:06.273388    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:06.273746 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:06.273268    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:06.273746 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:06.273381    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:06.273746 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:06.273509    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:06.273746 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:06.273625    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:08.273963 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:08.273926    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:08.273963 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:08.273956    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:08.274430 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:08.273926    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:08.274430 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:08.274052    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:08.274430 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:08.274113    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:08.274430 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:08.274205    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:09.898109 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:09.898065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:09.898552 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:09.898233    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 02:45:09.898552 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:09.898307    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret podName:4369624d-875b-416a-927a-80928ed35f04 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:25.898289299 +0000 UTC m=+34.125057979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret") pod "global-pull-secret-syncer-6xhcn" (UID: "4369624d-875b-416a-927a-80928ed35f04") : object "kube-system"/"original-pull-secret" not registered
Jul 20 02:45:09.999302 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:09.999266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:09.999484 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:09.999388    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:45:09.999484 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:09.999457    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:25.999436894 +0000 UTC m=+34.226205589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:45:10.099944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:10.099906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:10.100130 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:10.100108    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 02:45:10.100187 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:10.100135    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 02:45:10.100187 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:10.100152    2584 projected.go:196] Error preparing data for projected volume kube-api-access-s6ch5 for pod openshift-network-diagnostics/network-check-target-8jw6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:45:10.100272 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:10.100217    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5 podName:5b0798ce-b392-4f05-8582-f1f9ead610f7 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:26.100198817 +0000 UTC m=+34.326967499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6ch5" (UniqueName: "kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5") pod "network-check-target-8jw6m" (UID: "5b0798ce-b392-4f05-8582-f1f9ead610f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:45:10.274009 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:10.273933    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:10.274172 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:10.273932    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:10.274172 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:10.274064    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:10.274172 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:10.273941    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:10.274172 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:10.274138    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:10.274411 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:10.274234    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:12.274162 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:12.274114    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:12.274162 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:12.274142    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:12.274667 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:12.274285    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:12.274667 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:12.274317    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:12.274667 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:12.274394    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:12.274667 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:12.274486    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:14.273789 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:14.273753    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:14.274229 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:14.273759    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:14.274229 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:14.273888    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:14.274229 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:14.273759    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:14.274229 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:14.273949    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:14.274229 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:14.274069    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:15.535417 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:15.535387    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kjs8w" event={"ID":"ed646a9b-9280-4d49-bd09-125c0e528da7","Type":"ContainerStarted","Data":"9e5f855c3fff34f43b8b7a465895314ea3f60153560fd518f486e7f114799c7d"}
Jul 20 02:45:16.273815 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.273614    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:16.273957 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.273668    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:16.273957 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:16.273903    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:16.274025 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:16.273992    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:16.274058 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.273668    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:16.274131 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:16.274114    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:16.540370 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.540340    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64t7m" event={"ID":"e97a520a-d34e-48b1-bfc3-e4ad68daab2f","Type":"ContainerStarted","Data":"769dfabadef8b2dbc4b5ed4bf510e489073ea057626b3412466ffe9b4e612e60"}
Jul 20 02:45:16.542998 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.542980    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:45:16.543293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.543275    2584 generic.go:356] "Generic (PLEG): container finished" podID="c28062c6-fd4b-4d1c-9f84-fec38088ea7c" containerID="002c37021a9b2a622f275357ac5b8b17ff3a74683d0319dac96ec974e73c7fbd" exitCode=1
Jul 20 02:45:16.543367 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.543345    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerStarted","Data":"398500a4f33714716972ba95fbed622977306e3da53b9ce6bf4fb7b9681b8e98"}
Jul 20 02:45:16.543439 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.543424    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerStarted","Data":"a5187f52caf70e52786fc0e60893d3ee517e13b0f613d67cccdc55f52efb28ee"}
Jul 20 02:45:16.543491 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.543479    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerStarted","Data":"3395a1a499866a7d338c36081bb9f51a6546a7297676fdccaf95cb888483805d"}
Jul 20 02:45:16.543529 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.543522    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerStarted","Data":"015162cec2b43b400887ec60b63e2b727e3a2e496d71601987a34963701e026e"}
Jul 20 02:45:16.543561 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.543551    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerDied","Data":"002c37021a9b2a622f275357ac5b8b17ff3a74683d0319dac96ec974e73c7fbd"}
Jul 20 02:45:16.543606 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.543581    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerStarted","Data":"f91a88f482211556953a6cafb23a4700cbedf68e7dd693a60c6aac4cbb0da9f8"}
Jul 20 02:45:16.544676 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.544655    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kv9sm" event={"ID":"6fb1844f-0bb1-4982-b830-39500f72b0ef","Type":"ContainerStarted","Data":"677a148908029c672f5f197149e9bfd5fbba4fdd18068ccecb6e99f97fb7a264"}
Jul 20 02:45:16.545975 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.545949    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99bq9" event={"ID":"3f64af5e-79bf-454e-b1df-43637e20ae8c","Type":"ContainerStarted","Data":"9deb5348a5ae466759dca9f00038f3ef9abf68eea78a389c71a9a1e28ff0aafa"}
Jul 20 02:45:16.547210 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.547193    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vpdbw" event={"ID":"225e9e97-1891-45b6-a07c-9757e8e87138","Type":"ContainerStarted","Data":"9d4bbcb0df3592513b6ff316ab460da60c65419f9fa707002f41cc9c5f843bdc"}
Jul 20 02:45:16.548555 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.548537    2584 generic.go:356] "Generic (PLEG): container finished" podID="5940e4bee1f971108f9452c22f76a23d" containerID="223322b716f5e76e569df12c7c98884f85689b827cf1ff6b6d31f07d2fd64719" exitCode=0
Jul 20 02:45:16.548656 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.548594    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal" event={"ID":"5940e4bee1f971108f9452c22f76a23d","Type":"ContainerDied","Data":"223322b716f5e76e569df12c7c98884f85689b827cf1ff6b6d31f07d2fd64719"}
Jul 20 02:45:16.549972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.549947    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rvrp" event={"ID":"f8f8406a-9cb8-4430-a338-4d5400caa917","Type":"ContainerStarted","Data":"da7204d6b56a7f208fc2fd79b115576d02fc87145116513c638aed12dd76e0a2"}
Jul 20 02:45:16.551339 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.551321    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6" event={"ID":"801028ab-5ea4-484c-9861-2c003d1082a1","Type":"ContainerStarted","Data":"40e6fcec5535d88ebec95d7281371d1f22491e6e76640b9d67826609ff20a1df"}
Jul 20 02:45:16.552529 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.552505    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal" event={"ID":"8ab3262203e6413ceb558164a98b82dd","Type":"ContainerStarted","Data":"43c9d34d6edc09903ffdf43ecf73748e6ee80117cf0d4c241a430af141efdfcd"}
Jul 20 02:45:16.570142 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.570099    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7rvrp" podStartSLOduration=2.76952722 podStartE2EDuration="23.570086223s" totalImagesPullingTime="20.800559003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:16.569651487 +0000 UTC m=+24.796420195" watchObservedRunningTime="2026-07-20 02:45:16.570086223 +0000 UTC m=+24.796854927"
Jul 20 02:45:16.590056 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.589829    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-99bq9" podStartSLOduration=2.784160585 podStartE2EDuration="23.589813639s" totalImagesPullingTime="20.805653054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:16.589223947 +0000 UTC m=+24.815992675" watchObservedRunningTime="2026-07-20 02:45:16.589813639 +0000 UTC m=+24.816582342"
Jul 20 02:45:16.613075 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.613036    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kv9sm" podStartSLOduration=2.8577211719999998 podStartE2EDuration="23.61301862s" totalImagesPullingTime="20.755297448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:16.612839854 +0000 UTC m=+24.839608575" watchObservedRunningTime="2026-07-20 02:45:16.61301862 +0000 UTC m=+24.839787319"
Jul 20 02:45:16.637558 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.637518    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kjs8w" podStartSLOduration=2.897360709 podStartE2EDuration="23.637503401s" totalImagesPullingTime="20.740142692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:16.637181115 +0000 UTC m=+24.863949828" watchObservedRunningTime="2026-07-20 02:45:16.637503401 +0000 UTC m=+24.864272102"
Jul 20 02:45:16.652321 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.652276    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-191.ec2.internal" podStartSLOduration=22.652259051 podStartE2EDuration="22.652259051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:16.652232612 +0000 UTC m=+24.879001312" watchObservedRunningTime="2026-07-20 02:45:16.652259051 +0000 UTC m=+24.879027754"
Jul 20 02:45:16.665375 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:16.665284    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vpdbw" podStartSLOduration=7.294324285 podStartE2EDuration="23.665267892s" totalImagesPullingTime="16.370943607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:16.664628662 +0000 UTC m=+24.891397382" watchObservedRunningTime="2026-07-20 02:45:16.665267892 +0000 UTC m=+24.892036593"
Jul 20 02:45:17.508053 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.508018    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:45:17.508577 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.508559    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:45:17.555587 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.555554    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mbjmw" event={"ID":"2a002f6d-7f30-4bf4-95e1-28639716d110","Type":"ContainerStarted","Data":"1e5315f17e6edab169868e26d16fa13a239b89d65b07a43c8aef225b1d2aa37a"}
Jul 20 02:45:17.556901 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.556876    2584 generic.go:356] "Generic (PLEG): container finished" podID="e97a520a-d34e-48b1-bfc3-e4ad68daab2f" containerID="769dfabadef8b2dbc4b5ed4bf510e489073ea057626b3412466ffe9b4e612e60" exitCode=0
Jul 20 02:45:17.557003 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.556957    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64t7m" event={"ID":"e97a520a-d34e-48b1-bfc3-e4ad68daab2f","Type":"ContainerDied","Data":"769dfabadef8b2dbc4b5ed4bf510e489073ea057626b3412466ffe9b4e612e60"}
Jul 20 02:45:17.563129 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.563099    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal" event={"ID":"5940e4bee1f971108f9452c22f76a23d","Type":"ContainerStarted","Data":"a5c91a2f9c179eee79a65f7bc17ae573351d13955775564af2b5acc35f9f8263"}
Jul 20 02:45:17.563668 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.563631    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:45:17.564031 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.564016    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7rvrp"
Jul 20 02:45:17.568136 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.568101    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mbjmw" podStartSLOduration=4.116396203 podStartE2EDuration="24.568090133s" totalImagesPullingTime="20.45169393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:17.56784062 +0000 UTC m=+25.794609319" watchObservedRunningTime="2026-07-20 02:45:17.568090133 +0000 UTC m=+25.794858833"
Jul 20 02:45:17.613614 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.613571    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-191.ec2.internal" podStartSLOduration=23.613554642 podStartE2EDuration="23.613554642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:17.613490852 +0000 UTC m=+25.840259564" watchObservedRunningTime="2026-07-20 02:45:17.613554642 +0000 UTC m=+25.840323344"
Jul 20 02:45:17.767840 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:17.767773    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 02:45:18.223032 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:18.222939    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T02:45:17.767796103Z","UUID":"a09cb0c4-9c40-4f99-b4cd-0dd2f606feb1","Handler":null,"Name":"","Endpoint":""}
Jul 20 02:45:18.224378 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:18.224359    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 02:45:18.224481 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:18.224394    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 02:45:18.273902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:18.273878    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:18.273902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:18.273903    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:18.274113 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:18.273903    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:18.274113 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:18.274025    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:18.274282 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:18.274121    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:18.274282 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:18.274191    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:18.568888 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:18.568850    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:45:18.569499 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:18.569326    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerStarted","Data":"1d8b74887c66d92fa644fd6947b91fef1e3c0cc4cafbec96674c42cd51093f93"}
Jul 20 02:45:18.571301 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:18.571275    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6" event={"ID":"801028ab-5ea4-484c-9861-2c003d1082a1","Type":"ContainerStarted","Data":"f05d20fb4961a6f4ff390887b1b804dfadaaf0f60e5c095146f6fdc7afb397c0"}
Jul 20 02:45:19.578972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:19.578928    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6" event={"ID":"801028ab-5ea4-484c-9861-2c003d1082a1","Type":"ContainerStarted","Data":"e85d6587c18f9aed45fa9cd91c7fc79896378e10585ce6b8b56bc81e47cb3914"}
Jul 20 02:45:19.595471 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:19.595415    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-445n6" podStartSLOduration=3.264619402 podStartE2EDuration="26.595402406s" totalImagesPullingTime="23.330783004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:19.595030615 +0000 UTC m=+27.821799305" watchObservedRunningTime="2026-07-20 02:45:19.595402406 +0000 UTC m=+27.822171106"
Jul 20 02:45:20.273904 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:20.273865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:20.274139 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:20.273921    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:20.274139 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:20.273865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:20.274139 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:20.274003    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:20.274139 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:20.274068    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:20.274377 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:20.274218    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:20.586608 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:20.586233    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:45:20.587746 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:20.586999    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerStarted","Data":"a0672c26c2aa3838b887acf90a1069f442b01c08f9804ea4e951b78e793aa2b9"}
Jul 20 02:45:20.587746 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:20.587505    2584 scope.go:117] "RemoveContainer" containerID="002c37021a9b2a622f275357ac5b8b17ff3a74683d0319dac96ec974e73c7fbd"
Jul 20 02:45:21.593519 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:21.593491    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:45:21.594280 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:21.593954    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" event={"ID":"c28062c6-fd4b-4d1c-9f84-fec38088ea7c","Type":"ContainerStarted","Data":"230c653c1d3aee065f4960ee202bbf849c02634d8e091f565f0fe4b83a9505e3"}
Jul 20 02:45:21.594280 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:21.594066    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 02:45:21.594280 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:21.594276    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:45:21.594430 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:21.594330    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:45:21.612243 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:21.612221    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:45:21.612378 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:21.612335    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:45:21.620458 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:21.620421    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm" podStartSLOduration=7.693303468 podStartE2EDuration="28.620406435s" totalImagesPullingTime="20.927102967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:21.619889531 +0000 UTC m=+29.846658282" watchObservedRunningTime="2026-07-20 02:45:21.620406435 +0000 UTC m=+29.847175134"
Jul 20 02:45:22.274445 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.274414    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:22.274733 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.274499    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:22.274733 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.274539    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:22.274733 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:22.274625    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:22.275030 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:22.274996    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:22.275152 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:22.275034    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:22.596486 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.596459    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 02:45:22.840596 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.840561    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6xhcn"]
Jul 20 02:45:22.840761 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.840671    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:22.840814 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:22.840772    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:22.843767 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.843741    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8jw6m"]
Jul 20 02:45:22.843893 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.843834    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:22.843954 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:22.843912    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:22.844542 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.844519    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-284dq"]
Jul 20 02:45:22.844612 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:22.844596    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:22.844715 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:22.844697    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:23.600165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:23.600129    2584 generic.go:356] "Generic (PLEG): container finished" podID="e97a520a-d34e-48b1-bfc3-e4ad68daab2f" containerID="1209cd52fce0b783f0680ef769acce0108fc49c275da0fcfccd21e131e1cff05" exitCode=0
Jul 20 02:45:23.600537 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:23.600213    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64t7m" event={"ID":"e97a520a-d34e-48b1-bfc3-e4ad68daab2f","Type":"ContainerDied","Data":"1209cd52fce0b783f0680ef769acce0108fc49c275da0fcfccd21e131e1cff05"}
Jul 20 02:45:23.600537 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:23.600270    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 02:45:24.273604 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:24.273569    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:24.273781 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:24.273717    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:24.273851 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:24.273776    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:24.273908 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:24.273890    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:24.286912 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:24.286891    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:45:25.273591 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:25.273568    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:25.273909 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:25.273701    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:25.606691 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:25.606661    2584 generic.go:356] "Generic (PLEG): container finished" podID="e97a520a-d34e-48b1-bfc3-e4ad68daab2f" containerID="7c4ca992d4264b4bf77004fe7e5ddd288110c6e2812060417cd445b2bd30d908" exitCode=0
Jul 20 02:45:25.606870 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:25.606725    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64t7m" event={"ID":"e97a520a-d34e-48b1-bfc3-e4ad68daab2f","Type":"ContainerDied","Data":"7c4ca992d4264b4bf77004fe7e5ddd288110c6e2812060417cd445b2bd30d908"}
Jul 20 02:45:25.918505 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:25.918421    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:25.918659 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:25.918520    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 02:45:25.918659 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:25.918565    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret podName:4369624d-875b-416a-927a-80928ed35f04 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:57.918554437 +0000 UTC m=+66.145323116 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret") pod "global-pull-secret-syncer-6xhcn" (UID: "4369624d-875b-416a-927a-80928ed35f04") : object "kube-system"/"original-pull-secret" not registered
Jul 20 02:45:26.019781 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:26.019751    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:26.019935 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:26.019854    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:45:26.019935 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:26.019901    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:58.019888741 +0000 UTC m=+66.246657420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 02:45:26.120137 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:26.120108    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:26.120290 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:26.120266    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 02:45:26.120290 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:26.120286    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 02:45:26.120357 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:26.120295    2584 projected.go:196] Error preparing data for projected volume kube-api-access-s6ch5 for pod openshift-network-diagnostics/network-check-target-8jw6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:45:26.120357 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:26.120343    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5 podName:5b0798ce-b392-4f05-8582-f1f9ead610f7 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:58.120328742 +0000 UTC m=+66.347097424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6ch5" (UniqueName: "kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5") pod "network-check-target-8jw6m" (UID: "5b0798ce-b392-4f05-8582-f1f9ead610f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 02:45:26.273460 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:26.273383    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:26.273460 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:26.273425    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:26.273625 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:26.273508    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:26.273935 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:26.273630    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:27.273550 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:27.273463    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:27.273730 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:27.273571    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:27.613517 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:27.613266    2584 generic.go:356] "Generic (PLEG): container finished" podID="e97a520a-d34e-48b1-bfc3-e4ad68daab2f" containerID="8c582c6d16e331bc8f915ff3fd6f45c4ecce86adf8b63105e78126f659345719" exitCode=0
Jul 20 02:45:27.613718 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:27.613350    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64t7m" event={"ID":"e97a520a-d34e-48b1-bfc3-e4ad68daab2f","Type":"ContainerDied","Data":"8c582c6d16e331bc8f915ff3fd6f45c4ecce86adf8b63105e78126f659345719"}
Jul 20 02:45:28.273459 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:28.273430    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:28.273749 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:28.273430    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:28.274086 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:28.273772    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jw6m" podUID="5b0798ce-b392-4f05-8582-f1f9ead610f7"
Jul 20 02:45:28.274086 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:28.273842    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xhcn" podUID="4369624d-875b-416a-927a-80928ed35f04"
Jul 20 02:45:29.274072 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.274047    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:29.274401 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:29.274162    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:45:29.545057 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.545029    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-191.ec2.internal" event="NodeReady"
Jul 20 02:45:29.545268 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.545194    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 02:45:29.579080 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.579043    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76c5564449-659jx"]
Jul 20 02:45:29.582362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.582324    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"]
Jul 20 02:45:29.582497 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.582468    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.584650 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.584605    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 02:45:29.584650 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.584621    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwwjm\""
Jul 20 02:45:29.584650 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.584634    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 02:45:29.584906 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.584777    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 02:45:29.586318 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.586296    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:29.588935 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.588673    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bj7p5\""
Jul 20 02:45:29.588935 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.588882    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 02:45:29.590517 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.589911    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 02:45:29.591667 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.591628    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 02:45:29.592372 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.592354    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bnqc8"]
Jul 20 02:45:29.596092 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.596073    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"]
Jul 20 02:45:29.596284 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.596255    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76c5564449-659jx"]
Jul 20 02:45:29.596407 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.596358    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.598404 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.598385    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 02:45:29.598738 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.598723    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nz45m\""
Jul 20 02:45:29.599167 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.599147    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 02:45:29.605200 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.605154    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bnqc8"]
Jul 20 02:45:29.645211 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645174    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.645211 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645209    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnkx5\" (UniqueName: \"kubernetes.io/projected/83c8b733-cd7c-47e5-b02a-30d52a36766a-kube-api-access-gnkx5\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.645523 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:29.645523 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645369    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-image-registry-private-configuration\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.645523 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645406    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.645523 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645429    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j55gc\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-kube-api-access-j55gc\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.645523 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-ca-trust-extracted\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.645523 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645495    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-trusted-ca\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.645859 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-certificates\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.645859 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645549    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e4e21eb-855e-4a48-8424-5d9d4791a858-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:29.645859 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645564    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-installation-pull-secrets\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.645859 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645610    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c8b733-cd7c-47e5-b02a-30d52a36766a-tmp-dir\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.645859 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645661    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-bound-sa-token\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.645859 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.645688    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83c8b733-cd7c-47e5-b02a-30d52a36766a-config-volume\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.693766 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.693733    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lcdxk"]
Jul 20 02:45:29.697402 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.697380    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lcdxk"
Jul 20 02:45:29.699437 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.699412    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 02:45:29.699437 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.699433    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 02:45:29.699582 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.699447    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 02:45:29.699582 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.699415    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mhmn8\""
Jul 20 02:45:29.703249 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.703221    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lcdxk"]
Jul 20 02:45:29.746286 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746247    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-bound-sa-token\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.746480 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746310    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83c8b733-cd7c-47e5-b02a-30d52a36766a-config-volume\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.746480 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.746480 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkx5\" (UniqueName: \"kubernetes.io/projected/83c8b733-cd7c-47e5-b02a-30d52a36766a-kube-api-access-gnkx5\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.746480 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:29.746619 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-image-registry-private-configuration\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.746619 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746521    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.746619 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:29.746536    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 02:45:29.746619 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:29.746600    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls podName:83c8b733-cd7c-47e5-b02a-30d52a36766a nodeName:}" failed. No retries permitted until 2026-07-20 02:45:30.246580653 +0000 UTC m=+38.473349335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls") pod "dns-default-bnqc8" (UID: "83c8b733-cd7c-47e5-b02a-30d52a36766a") : secret "dns-default-metrics-tls" not found
Jul 20 02:45:29.746781 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746543    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j55gc\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-kube-api-access-j55gc\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.746781 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746759    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dtp2\" (UniqueName: \"kubernetes.io/projected/6dff67a4-0a44-4ab9-8614-ca174b41e699-kube-api-access-2dtp2\") pod \"ingress-canary-lcdxk\" (UID: \"6dff67a4-0a44-4ab9-8614-ca174b41e699\") " pod="openshift-ingress-canary/ingress-canary-lcdxk"
Jul 20 02:45:29.746852 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:29.746782    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 02:45:29.746852 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:29.746798    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c5564449-659jx: secret "image-registry-tls" not found
Jul 20 02:45:29.746852 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:29.746800    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 02:45:29.746947 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:29.746858    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls podName:daf110bc-f49b-4a57-bca9-ff688ce7d3ca nodeName:}" failed. No retries permitted until 2026-07-20 02:45:30.246841156 +0000 UTC m=+38.473609848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls") pod "image-registry-76c5564449-659jx" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca") : secret "image-registry-tls" not found
Jul 20 02:45:29.746947 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746800    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-ca-trust-extracted\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.746947 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:29.746875    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert podName:2e4e21eb-855e-4a48-8424-5d9d4791a858 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:30.246866513 +0000 UTC m=+38.473635194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-sxpjx" (UID: "2e4e21eb-855e-4a48-8424-5d9d4791a858") : secret "networking-console-plugin-cert" not found
Jul 20 02:45:29.746947 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.746927    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-trusted-ca\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.747087 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747035    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83c8b733-cd7c-47e5-b02a-30d52a36766a-config-volume\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.747122 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747083    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-certificates\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.747122 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747101    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-ca-trust-extracted\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.747182 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747118    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e4e21eb-855e-4a48-8424-5d9d4791a858-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:29.747182 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747142    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-installation-pull-secrets\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.747182 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c8b733-cd7c-47e5-b02a-30d52a36766a-tmp-dir\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.747310 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747207    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dff67a4-0a44-4ab9-8614-ca174b41e699-cert\") pod \"ingress-canary-lcdxk\" (UID: \"6dff67a4-0a44-4ab9-8614-ca174b41e699\") " pod="openshift-ingress-canary/ingress-canary-lcdxk"
Jul 20 02:45:29.747494 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747468    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c8b733-cd7c-47e5-b02a-30d52a36766a-tmp-dir\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.747725 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747688    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-certificates\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.747810 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747751    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e4e21eb-855e-4a48-8424-5d9d4791a858-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:29.747967 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.747946    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-trusted-ca\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.751529 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.751497    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-image-registry-private-configuration\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.751664 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.751497    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-installation-pull-secrets\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.754227 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.754203    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnkx5\" (UniqueName: \"kubernetes.io/projected/83c8b733-cd7c-47e5-b02a-30d52a36766a-kube-api-access-gnkx5\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:29.754700 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.754681    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-bound-sa-token\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.755001 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.754980    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j55gc\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-kube-api-access-j55gc\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:29.848551 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.848459    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dtp2\" (UniqueName: \"kubernetes.io/projected/6dff67a4-0a44-4ab9-8614-ca174b41e699-kube-api-access-2dtp2\") pod \"ingress-canary-lcdxk\" (UID: \"6dff67a4-0a44-4ab9-8614-ca174b41e699\") " pod="openshift-ingress-canary/ingress-canary-lcdxk"
Jul 20 02:45:29.848551 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.848519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dff67a4-0a44-4ab9-8614-ca174b41e699-cert\") pod \"ingress-canary-lcdxk\" (UID: \"6dff67a4-0a44-4ab9-8614-ca174b41e699\") " pod="openshift-ingress-canary/ingress-canary-lcdxk"
Jul 20 02:45:29.851357 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.851328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dff67a4-0a44-4ab9-8614-ca174b41e699-cert\") pod \"ingress-canary-lcdxk\" (UID: \"6dff67a4-0a44-4ab9-8614-ca174b41e699\") " pod="openshift-ingress-canary/ingress-canary-lcdxk"
Jul 20 02:45:29.855469 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.855446    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dtp2\" (UniqueName: \"kubernetes.io/projected/6dff67a4-0a44-4ab9-8614-ca174b41e699-kube-api-access-2dtp2\") pod \"ingress-canary-lcdxk\" (UID: \"6dff67a4-0a44-4ab9-8614-ca174b41e699\") " pod="openshift-ingress-canary/ingress-canary-lcdxk"
Jul 20 02:45:29.881431 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.881385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:29.963046 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:29.962974    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:30.007930 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.007897    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lcdxk"
Jul 20 02:45:30.109063 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.109027    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:30.154594 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.154557    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lcdxk"]
Jul 20 02:45:30.158633 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:45:30.158604    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dff67a4_0a44_4ab9_8614_ca174b41e699.slice/crio-1b2c585d7513d3a73d2a25550cfcb6f29fc3981f9dbae845d9d7c49520796681 WatchSource:0}: Error finding container 1b2c585d7513d3a73d2a25550cfcb6f29fc3981f9dbae845d9d7c49520796681: Status 404 returned error can't find the container with id 1b2c585d7513d3a73d2a25550cfcb6f29fc3981f9dbae845d9d7c49520796681
Jul 20 02:45:30.251017 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.250981    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:30.251218 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.251031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:30.251218 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.251067    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:30.251218 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:30.251175    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 02:45:30.251218 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:30.251194    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 02:45:30.251218 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:30.251196    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 02:45:30.251218 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:30.251213    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c5564449-659jx: secret "image-registry-tls" not found
Jul 20 02:45:30.251454 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:30.251262    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert podName:2e4e21eb-855e-4a48-8424-5d9d4791a858 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:31.251242092 +0000 UTC m=+39.478010774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-sxpjx" (UID: "2e4e21eb-855e-4a48-8424-5d9d4791a858") : secret "networking-console-plugin-cert" not found
Jul 20 02:45:30.251454 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:30.251280    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls podName:daf110bc-f49b-4a57-bca9-ff688ce7d3ca nodeName:}" failed. No retries permitted until 2026-07-20 02:45:31.251271119 +0000 UTC m=+39.478039798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls") pod "image-registry-76c5564449-659jx" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca") : secret "image-registry-tls" not found
Jul 20 02:45:30.251454 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:30.251293    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls podName:83c8b733-cd7c-47e5-b02a-30d52a36766a nodeName:}" failed. No retries permitted until 2026-07-20 02:45:31.251286427 +0000 UTC m=+39.478055109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls") pod "dns-default-bnqc8" (UID: "83c8b733-cd7c-47e5-b02a-30d52a36766a") : secret "dns-default-metrics-tls" not found
Jul 20 02:45:30.274162 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.274128    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:30.275061 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.274320    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:30.276353 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.276327    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 02:45:30.276458 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.276376    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 02:45:30.276658 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.276628    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jphph\""
Jul 20 02:45:30.276722 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.276688    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 02:45:30.488427 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.488348    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:30.622488 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.622451    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lcdxk" event={"ID":"6dff67a4-0a44-4ab9-8614-ca174b41e699","Type":"ContainerStarted","Data":"1b2c585d7513d3a73d2a25550cfcb6f29fc3981f9dbae845d9d7c49520796681"}
Jul 20 02:45:30.669996 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:30.669963    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:31.072436 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:31.072378    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:31.176461 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:31.176422    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:31.260387 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:31.260342    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:31.260550 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:31.260389    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:31.260550 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:31.260496    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 02:45:31.260550 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:31.260506    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 02:45:31.260729 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:31.260556    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert podName:2e4e21eb-855e-4a48-8424-5d9d4791a858 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:33.260538279 +0000 UTC m=+41.487306966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-sxpjx" (UID: "2e4e21eb-855e-4a48-8424-5d9d4791a858") : secret "networking-console-plugin-cert" not found
Jul 20 02:45:31.260729 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:31.260577    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:31.260729 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:31.260666    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls podName:83c8b733-cd7c-47e5-b02a-30d52a36766a nodeName:}" failed. No retries permitted until 2026-07-20 02:45:33.260654168 +0000 UTC m=+41.487422850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls") pod "dns-default-bnqc8" (UID: "83c8b733-cd7c-47e5-b02a-30d52a36766a") : secret "dns-default-metrics-tls" not found
Jul 20 02:45:31.260881 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:31.260735    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 02:45:31.260881 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:31.260746    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c5564449-659jx: secret "image-registry-tls" not found
Jul 20 02:45:31.260881 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:31.260782    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls podName:daf110bc-f49b-4a57-bca9-ff688ce7d3ca nodeName:}" failed. No retries permitted until 2026-07-20 02:45:33.260770298 +0000 UTC m=+41.487538982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls") pod "image-registry-76c5564449-659jx" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca") : secret "image-registry-tls" not found
Jul 20 02:45:31.273817 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:31.273792    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:31.275909 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:31.275883    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8vd4r\""
Jul 20 02:45:31.276222 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:31.275884    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 02:45:31.671760 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:31.671726    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:32.630003 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:32.629969    2584 generic.go:356] "Generic (PLEG): container finished" podID="e97a520a-d34e-48b1-bfc3-e4ad68daab2f" containerID="d1a21490a4f4f096860b57aa5107d97575c415f72150fa53afc19dbed1266e8e" exitCode=0
Jul 20 02:45:32.630465 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:32.630026    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64t7m" event={"ID":"e97a520a-d34e-48b1-bfc3-e4ad68daab2f","Type":"ContainerDied","Data":"d1a21490a4f4f096860b57aa5107d97575c415f72150fa53afc19dbed1266e8e"}
Jul 20 02:45:32.810598 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:32.810555    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:32.859967 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:32.859936    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:33.277233 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:33.277199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:33.277233 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:33.277239    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:33.277458 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:33.277281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:33.277458 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:33.277438    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 02:45:33.277553 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:33.277535    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls podName:83c8b733-cd7c-47e5-b02a-30d52a36766a nodeName:}" failed. No retries permitted until 2026-07-20 02:45:37.277512414 +0000 UTC m=+45.504281106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls") pod "dns-default-bnqc8" (UID: "83c8b733-cd7c-47e5-b02a-30d52a36766a") : secret "dns-default-metrics-tls" not found
Jul 20 02:45:33.277553 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:33.277540    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 02:45:33.277673 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:33.277560    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c5564449-659jx: secret "image-registry-tls" not found
Jul 20 02:45:33.277673 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:33.277573    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 02:45:33.277673 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:33.277611    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls podName:daf110bc-f49b-4a57-bca9-ff688ce7d3ca nodeName:}" failed. No retries permitted until 2026-07-20 02:45:37.277595443 +0000 UTC m=+45.504364137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls") pod "image-registry-76c5564449-659jx" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca") : secret "image-registry-tls" not found
Jul 20 02:45:33.277673 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:33.277631    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert podName:2e4e21eb-855e-4a48-8424-5d9d4791a858 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:37.277621279 +0000 UTC m=+45.504389964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-sxpjx" (UID: "2e4e21eb-855e-4a48-8424-5d9d4791a858") : secret "networking-console-plugin-cert" not found
Jul 20 02:45:33.635706 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:33.635671    2584 generic.go:356] "Generic (PLEG): container finished" podID="e97a520a-d34e-48b1-bfc3-e4ad68daab2f" containerID="9ecc9dc0ca9010dcd4591708f2e919edf8341138795aa191d0c7a93b459cc0d8" exitCode=0
Jul 20 02:45:33.636117 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:33.635732    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64t7m" event={"ID":"e97a520a-d34e-48b1-bfc3-e4ad68daab2f","Type":"ContainerDied","Data":"9ecc9dc0ca9010dcd4591708f2e919edf8341138795aa191d0c7a93b459cc0d8"}
Jul 20 02:45:34.641704 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:34.641665    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64t7m" event={"ID":"e97a520a-d34e-48b1-bfc3-e4ad68daab2f","Type":"ContainerStarted","Data":"00c50fb4ca8a6e7be7abbd707c2b018c45a68fe4a590504a78d9a8b4e5ed8a98"}
Jul 20 02:45:34.643177 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:34.643156    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lcdxk" event={"ID":"6dff67a4-0a44-4ab9-8614-ca174b41e699","Type":"ContainerStarted","Data":"a56f318263ab7ea6d13593f0b0347ae6cb4a1e96c43067ee9abcc3b4d60206c4"}
Jul 20 02:45:34.661524 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:34.661475    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-64t7m" podStartSLOduration=8.612444612 podStartE2EDuration="41.661459274s" totalImagesPullingTime="33.049014662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:34.660547036 +0000 UTC m=+42.887315794" watchObservedRunningTime="2026-07-20 02:45:34.661459274 +0000 UTC m=+42.888227974"
Jul 20 02:45:34.675964 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:34.675925    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lcdxk" podStartSLOduration=1.356246662 podStartE2EDuration="5.675913123s" totalImagesPullingTime="4.319666461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:45:34.675252122 +0000 UTC m=+42.902020845" watchObservedRunningTime="2026-07-20 02:45:34.675913123 +0000 UTC m=+42.902681873"
Jul 20 02:45:34.789408 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:34.789370    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:34.839079 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:34.839057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:37.306171 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:37.306141    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:37.306546 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:37.306177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:37.306546 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:37.306205    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:37.306546 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:37.306287    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 02:45:37.306546 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:37.306343    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls podName:83c8b733-cd7c-47e5-b02a-30d52a36766a nodeName:}" failed. No retries permitted until 2026-07-20 02:45:45.306327972 +0000 UTC m=+53.533096653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls") pod "dns-default-bnqc8" (UID: "83c8b733-cd7c-47e5-b02a-30d52a36766a") : secret "dns-default-metrics-tls" not found
Jul 20 02:45:37.306546 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:37.306287    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 02:45:37.306546 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:37.306421    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert podName:2e4e21eb-855e-4a48-8424-5d9d4791a858 nodeName:}" failed. No retries permitted until 2026-07-20 02:45:45.306407499 +0000 UTC m=+53.533176178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-sxpjx" (UID: "2e4e21eb-855e-4a48-8424-5d9d4791a858") : secret "networking-console-plugin-cert" not found
Jul 20 02:45:37.306546 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:37.306290    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 02:45:37.306546 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:37.306438    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c5564449-659jx: secret "image-registry-tls" not found
Jul 20 02:45:37.306546 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:37.306460    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls podName:daf110bc-f49b-4a57-bca9-ff688ce7d3ca nodeName:}" failed. No retries permitted until 2026-07-20 02:45:45.306453651 +0000 UTC m=+53.533222330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls") pod "image-registry-76c5564449-659jx" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca") : secret "image-registry-tls" not found
Jul 20 02:45:43.770078 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:43.770046    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:43.820177 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:43.820144    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:45.363684 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:45.363629    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:45:45.364146 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:45.363691    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:45:45.364146 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:45.363778    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 02:45:45.364146 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:45.363791    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 02:45:45.364146 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:45.363879    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:45:45.364146 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:45.363951    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls podName:83c8b733-cd7c-47e5-b02a-30d52a36766a nodeName:}" failed. No retries permitted until 2026-07-20 02:46:01.363913874 +0000 UTC m=+69.590682565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls") pod "dns-default-bnqc8" (UID: "83c8b733-cd7c-47e5-b02a-30d52a36766a") : secret "dns-default-metrics-tls" not found
Jul 20 02:45:45.364146 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:45.363976    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 02:45:45.364146 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:45.363987    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c5564449-659jx: secret "image-registry-tls" not found
Jul 20 02:45:45.364146 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:45.363978    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert podName:2e4e21eb-855e-4a48-8424-5d9d4791a858 nodeName:}" failed. No retries permitted until 2026-07-20 02:46:01.363968464 +0000 UTC m=+69.590737143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-sxpjx" (UID: "2e4e21eb-855e-4a48-8424-5d9d4791a858") : secret "networking-console-plugin-cert" not found
Jul 20 02:45:45.364146 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:45.364037    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls podName:daf110bc-f49b-4a57-bca9-ff688ce7d3ca nodeName:}" failed. No retries permitted until 2026-07-20 02:46:01.364025275 +0000 UTC m=+69.590793954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls") pod "image-registry-76c5564449-659jx" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca") : secret "image-registry-tls" not found
Jul 20 02:45:45.639478 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:45.639397    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:45.696101 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:45.696069    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:45.767152 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:45.767123    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:45.841544 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:45.841519    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:45.900122 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:45.900057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:46.211610 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:46.211537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:46.312028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:46.311999    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:54.612363 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:54.612330    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-drpnm"
Jul 20 02:45:54.759162 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:54.759129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:54.812026 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:54.811992    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:45:57.957476 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:57.957428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:57.959754 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:57.959738    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 02:45:57.971455 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:57.971423    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4369624d-875b-416a-927a-80928ed35f04-original-pull-secret\") pod \"global-pull-secret-syncer-6xhcn\" (UID: \"4369624d-875b-416a-927a-80928ed35f04\") " pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:58.058000 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.057961    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:45:58.060371 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.060349    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 02:45:58.068852 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:58.068831    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 02:45:58.068939 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:45:58.068912    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:47:02.068891413 +0000 UTC m=+130.295660091 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : secret "metrics-daemon-secret" not found
Jul 20 02:45:58.159354 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.159307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:58.161591 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.161571    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 02:45:58.171596 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.171574    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 02:45:58.183307 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.183278    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6ch5\" (UniqueName: \"kubernetes.io/projected/5b0798ce-b392-4f05-8582-f1f9ead610f7-kube-api-access-s6ch5\") pod \"network-check-target-8jw6m\" (UID: \"5b0798ce-b392-4f05-8582-f1f9ead610f7\") " pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:58.188911 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.188893    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jphph\""
Jul 20 02:45:58.192274 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.192261    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xhcn"
Jul 20 02:45:58.197911 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.197894    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:45:58.330166 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.330123    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6xhcn"]
Jul 20 02:45:58.333758 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:45:58.333732    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4369624d_875b_416a_927a_80928ed35f04.slice/crio-bd2a411f974a7338dda717bde15596a08835549048e45b8d441f39f3dbffec62 WatchSource:0}: Error finding container bd2a411f974a7338dda717bde15596a08835549048e45b8d441f39f3dbffec62: Status 404 returned error can't find the container with id bd2a411f974a7338dda717bde15596a08835549048e45b8d441f39f3dbffec62
Jul 20 02:45:58.340047 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.340019    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8jw6m"]
Jul 20 02:45:58.342992 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:45:58.342970    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0798ce_b392_4f05_8582_f1f9ead610f7.slice/crio-60e911be23f95548ebda876e6fdd9b39ee1bd4480228f251164bc551f4fab661 WatchSource:0}: Error finding container 60e911be23f95548ebda876e6fdd9b39ee1bd4480228f251164bc551f4fab661: Status 404 returned error can't find the container with id 60e911be23f95548ebda876e6fdd9b39ee1bd4480228f251164bc551f4fab661
Jul 20 02:45:58.697878 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.697835    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8jw6m" event={"ID":"5b0798ce-b392-4f05-8582-f1f9ead610f7","Type":"ContainerStarted","Data":"60e911be23f95548ebda876e6fdd9b39ee1bd4480228f251164bc551f4fab661"}
Jul 20 02:45:58.698847 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:45:58.698825    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6xhcn" event={"ID":"4369624d-875b-416a-927a-80928ed35f04","Type":"ContainerStarted","Data":"bd2a411f974a7338dda717bde15596a08835549048e45b8d441f39f3dbffec62"}
Jul 20 02:46:01.385426 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:01.385328    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:46:01.385426 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:01.385404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:46:01.386088 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:01.385495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:46:01.386088 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:01.385506    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 02:46:01.386088 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:01.385566    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 02:46:01.386088 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:01.385581    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 02:46:01.386088 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:01.385584    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c5564449-659jx: secret "image-registry-tls" not found
Jul 20 02:46:01.386088 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:01.385587    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert podName:2e4e21eb-855e-4a48-8424-5d9d4791a858 nodeName:}" failed. No retries permitted until 2026-07-20 02:46:33.385562749 +0000 UTC m=+101.612331445 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-sxpjx" (UID: "2e4e21eb-855e-4a48-8424-5d9d4791a858") : secret "networking-console-plugin-cert" not found
Jul 20 02:46:01.386088 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:01.385651    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls podName:daf110bc-f49b-4a57-bca9-ff688ce7d3ca nodeName:}" failed. No retries permitted until 2026-07-20 02:46:33.385619622 +0000 UTC m=+101.612388313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls") pod "image-registry-76c5564449-659jx" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca") : secret "image-registry-tls" not found
Jul 20 02:46:01.386088 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:01.385672    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls podName:83c8b733-cd7c-47e5-b02a-30d52a36766a nodeName:}" failed. No retries permitted until 2026-07-20 02:46:33.385663397 +0000 UTC m=+101.612432079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls") pod "dns-default-bnqc8" (UID: "83c8b733-cd7c-47e5-b02a-30d52a36766a") : secret "dns-default-metrics-tls" not found
Jul 20 02:46:03.713739 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:03.713701    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8jw6m" event={"ID":"5b0798ce-b392-4f05-8582-f1f9ead610f7","Type":"ContainerStarted","Data":"e23f1e6305dccb6f290ccef829b51cec92d86291d04180058005cb7f25e28c5d"}
Jul 20 02:46:03.714181 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:03.713794    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:46:03.715047 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:03.715021    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6xhcn" event={"ID":"4369624d-875b-416a-927a-80928ed35f04","Type":"ContainerStarted","Data":"b90c30b886fcb6ef2d463f7552fc56cef8acb6452fcdc9cbb69f60bcbe63e221"}
Jul 20 02:46:03.727340 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:03.727295    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8jw6m" podStartSLOduration=65.883965016 podStartE2EDuration="1m10.727280004s" totalImagesPullingTime="4.843314988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:46:03.725910126 +0000 UTC m=+71.952678826" watchObservedRunningTime="2026-07-20 02:46:03.727280004 +0000 UTC m=+71.954048702"
Jul 20 02:46:03.739170 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:03.739123    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6xhcn" podStartSLOduration=65.87591948 podStartE2EDuration="1m10.73910695s" totalImagesPullingTime="4.86318747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:46:03.738202762 +0000 UTC m=+71.964971480" watchObservedRunningTime="2026-07-20 02:46:03.73910695 +0000 UTC m=+71.965875650"
Jul 20 02:46:06.798132 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:06.798098    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:46:06.862266 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:06.862234    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:46:07.599195 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:07.599163    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:46:07.652106 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:07.652079    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:46:07.701590 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:07.701564    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:46:09.737761 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:09.737730    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:46:09.794840 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:09.794811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:46:33.421827 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:33.421786    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:46:33.421827 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:33.421830    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:46:33.422331 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:33.421851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:46:33.422331 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:33.421963    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 02:46:33.422331 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:33.421967    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 02:46:33.422331 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:33.422017    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 02:46:33.422331 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:33.422034    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c5564449-659jx: secret "image-registry-tls" not found
Jul 20 02:46:33.422331 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:33.422041    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert podName:2e4e21eb-855e-4a48-8424-5d9d4791a858 nodeName:}" failed. No retries permitted until 2026-07-20 02:47:37.422021953 +0000 UTC m=+165.648790632 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-sxpjx" (UID: "2e4e21eb-855e-4a48-8424-5d9d4791a858") : secret "networking-console-plugin-cert" not found
Jul 20 02:46:33.422331 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:33.422061    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls podName:83c8b733-cd7c-47e5-b02a-30d52a36766a nodeName:}" failed. No retries permitted until 2026-07-20 02:47:37.422050712 +0000 UTC m=+165.648819397 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls") pod "dns-default-bnqc8" (UID: "83c8b733-cd7c-47e5-b02a-30d52a36766a") : secret "dns-default-metrics-tls" not found
Jul 20 02:46:33.422331 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:46:33.422076    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls podName:daf110bc-f49b-4a57-bca9-ff688ce7d3ca nodeName:}" failed. No retries permitted until 2026-07-20 02:47:37.422067999 +0000 UTC m=+165.648836677 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls") pod "image-registry-76c5564449-659jx" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca") : secret "image-registry-tls" not found
Jul 20 02:46:34.720535 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:46:34.720505    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8jw6m"
Jul 20 02:47:02.128846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:47:02.128791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:47:02.129284 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:02.128934    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 02:47:02.129284 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:02.129000    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:04.128984762 +0000 UTC m=+252.355753440 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : secret "metrics-daemon-secret" not found
Jul 20 02:47:32.596824 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:32.596787    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76c5564449-659jx" podUID="daf110bc-f49b-4a57-bca9-ff688ce7d3ca"
Jul 20 02:47:32.605938 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:32.605914    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx" podUID="2e4e21eb-855e-4a48-8424-5d9d4791a858"
Jul 20 02:47:32.612115 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:32.612087    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bnqc8" podUID="83c8b733-cd7c-47e5-b02a-30d52a36766a"
Jul 20 02:47:32.916741 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:47:32.916660    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:47:32.916741 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:47:32.916696    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:47:32.916912 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:47:32.916668    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:47:34.285096 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:34.285056    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:47:37.485628 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:47:37.485577    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:47:37.486096 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:47:37.485660    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:47:37.486096 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:47:37.485692    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:47:37.486096 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:37.485751    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 02:47:37.486096 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:37.485809    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 02:47:37.486096 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:37.485818    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 02:47:37.486096 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:37.485831    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c5564449-659jx: secret "image-registry-tls" not found
Jul 20 02:47:37.486096 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:37.485852    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls podName:83c8b733-cd7c-47e5-b02a-30d52a36766a nodeName:}" failed. No retries permitted until 2026-07-20 02:49:39.485836173 +0000 UTC m=+287.712604853 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls") pod "dns-default-bnqc8" (UID: "83c8b733-cd7c-47e5-b02a-30d52a36766a") : secret "dns-default-metrics-tls" not found
Jul 20 02:47:37.486096 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:37.485867    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert podName:2e4e21eb-855e-4a48-8424-5d9d4791a858 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:39.48586131 +0000 UTC m=+287.712629989 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-sxpjx" (UID: "2e4e21eb-855e-4a48-8424-5d9d4791a858") : secret "networking-console-plugin-cert" not found
Jul 20 02:47:37.486096 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:47:37.485878    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls podName:daf110bc-f49b-4a57-bca9-ff688ce7d3ca nodeName:}" failed. No retries permitted until 2026-07-20 02:49:39.485872999 +0000 UTC m=+287.712641679 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls") pod "image-registry-76c5564449-659jx" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca") : secret "image-registry-tls" not found
Jul 20 02:47:48.273668 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:47:48.273570    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:48:37.335989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:48:37.335953    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:04.178073 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:04.178020    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:49:04.178487 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:04.178164    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 02:49:04.178487 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:04.178250    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs podName:9788e27f-288e-4bf0-99ce-aa3440d843a5 nodeName:}" failed. No retries permitted until 2026-07-20 02:51:06.178233028 +0000 UTC m=+374.405001710 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs") pod "network-metrics-daemon-284dq" (UID: "9788e27f-288e-4bf0-99ce-aa3440d843a5") : secret "metrics-daemon-secret" not found
Jul 20 02:49:10.918016 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.917979    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r"]
Jul 20 02:49:10.919926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.919910    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r"
Jul 20 02:49:10.922280 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.922256    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7jtnj\""
Jul 20 02:49:10.922489 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.922475    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 20 02:49:10.923231 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.923211    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 20 02:49:10.924395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.924368    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jspkh"]
Jul 20 02:49:10.926271 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.926243    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"]
Jul 20 02:49:10.926382 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.926364    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:10.928382 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.928366    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"]
Jul 20 02:49:10.928510 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.928494    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:10.930257 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.930239    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:10.931347 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.931332    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 20 02:49:10.931347 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.931341    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 20 02:49:10.933472 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.933454    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 20 02:49:10.933954 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.933727    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 20 02:49:10.933954 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.933782    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wklgj\""
Jul 20 02:49:10.934350 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.933997    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 02:49:10.934350 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.934058    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 20 02:49:10.934451 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.934348    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 20 02:49:10.934535 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.934514    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6z8jh\""
Jul 20 02:49:10.934704 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.934688    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 02:49:10.935108 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.934714    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 20 02:49:10.935108 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.934587    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 20 02:49:10.935108 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.934656    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8gthd\""
Jul 20 02:49:10.935108 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.934920    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r"]
Jul 20 02:49:10.935303 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.935278    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 20 02:49:10.942832 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.942813    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 20 02:49:10.943137 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.943120    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"]
Jul 20 02:49:10.945618 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.945601    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jspkh"]
Jul 20 02:49:10.970589 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:10.970559    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"]
Jul 20 02:49:11.027723 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027623    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-tmp\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.027723 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027696    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-snapshots\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.027723 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027726    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-service-ca-bundle\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.027989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027755    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f5a15af-3d20-4917-b235-23d3d270cedb-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-nfdqq\" (UID: \"9f5a15af-3d20-4917-b235-23d3d270cedb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.027989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027795    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:11.027989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027823    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.027989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027844    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4v7w\" (UniqueName: \"kubernetes.io/projected/a51b4b84-4ec8-47f3-b939-51017ed10daf-kube-api-access-t4v7w\") pod \"volume-data-source-validator-78cf4c6f6-vs27r\" (UID: \"a51b4b84-4ec8-47f3-b939-51017ed10daf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r"
Jul 20 02:49:11.027989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027925    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrch5\" (UniqueName: \"kubernetes.io/projected/9cb46a37-a646-4c80-9e62-1b7577f16f5b-kube-api-access-hrch5\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:11.027989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027966    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5h9z\" (UniqueName: \"kubernetes.io/projected/9f5a15af-3d20-4917-b235-23d3d270cedb-kube-api-access-k5h9z\") pod \"kube-storage-version-migrator-operator-7658d9b749-nfdqq\" (UID: \"9f5a15af-3d20-4917-b235-23d3d270cedb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.028204 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.027998    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-serving-cert\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.028204 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.028023    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f5a15af-3d20-4917-b235-23d3d270cedb-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-nfdqq\" (UID: \"9f5a15af-3d20-4917-b235-23d3d270cedb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.028204 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.028053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6ll\" (UniqueName: \"kubernetes.io/projected/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-kube-api-access-6n6ll\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.028574 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.028560    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"]
Jul 20 02:49:11.030553 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.030538    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67656b96-dhf9s"]
Jul 20 02:49:11.030687 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.030672    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.032371 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.032355    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.033875 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.033857    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 02:49:11.035821 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.035800    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q7dq9\""
Jul 20 02:49:11.035996 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.035977    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 20 02:49:11.036073 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.036021    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 20 02:49:11.036073 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.036024    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 20 02:49:11.036073 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.036033    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 20 02:49:11.036272 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.036257    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 20 02:49:11.036448 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.036432    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 20 02:49:11.036718 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.036704    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 02:49:11.036799 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.036722    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8k28d\""
Jul 20 02:49:11.036799 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.036736    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 02:49:11.036799 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.036736    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 02:49:11.044172 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.044155    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"]
Jul 20 02:49:11.059468 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.059445    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67656b96-dhf9s"]
Jul 20 02:49:11.128409 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128381    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:11.128409 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.128663 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128437    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/42629dc9-3a3d-459a-9b9d-7bd58a785c80-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.128663 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-default-certificate\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.128663 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128515    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4v7w\" (UniqueName: \"kubernetes.io/projected/a51b4b84-4ec8-47f3-b939-51017ed10daf-kube-api-access-t4v7w\") pod \"volume-data-source-validator-78cf4c6f6-vs27r\" (UID: \"a51b4b84-4ec8-47f3-b939-51017ed10daf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r"
Jul 20 02:49:11.128663 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.128599    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 02:49:11.128869 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.128698    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls podName:9cb46a37-a646-4c80-9e62-1b7577f16f5b nodeName:}" failed. No retries permitted until 2026-07-20 02:49:11.628676188 +0000 UTC m=+259.855444883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pnhj8" (UID: "9cb46a37-a646-4c80-9e62-1b7577f16f5b") : secret "samples-operator-tls" not found
Jul 20 02:49:11.128869 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128737    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjj5k\" (UniqueName: \"kubernetes.io/projected/42629dc9-3a3d-459a-9b9d-7bd58a785c80-kube-api-access-bjj5k\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.128869 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128801    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrch5\" (UniqueName: \"kubernetes.io/projected/9cb46a37-a646-4c80-9e62-1b7577f16f5b-kube-api-access-hrch5\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:11.128869 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128827    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5h9z\" (UniqueName: \"kubernetes.io/projected/9f5a15af-3d20-4917-b235-23d3d270cedb-kube-api-access-k5h9z\") pod \"kube-storage-version-migrator-operator-7658d9b749-nfdqq\" (UID: \"9f5a15af-3d20-4917-b235-23d3d270cedb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.128869 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128859    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.129134 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128907    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-serving-cert\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.129134 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.128985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f5a15af-3d20-4917-b235-23d3d270cedb-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-nfdqq\" (UID: \"9f5a15af-3d20-4917-b235-23d3d270cedb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.129134 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129016    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6ll\" (UniqueName: \"kubernetes.io/projected/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-kube-api-access-6n6ll\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.129134 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129062    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.129134 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129116    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-tmp\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.129134 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-stats-auth\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.129423 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129166    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-snapshots\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.129423 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129186    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-service-ca-bundle\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.129423 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129206    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f44mn\" (UniqueName: \"kubernetes.io/projected/35ca8fae-ee04-44bc-af17-fb63f987b537-kube-api-access-f44mn\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.129423 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129235    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f5a15af-3d20-4917-b235-23d3d270cedb-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-nfdqq\" (UID: \"9f5a15af-3d20-4917-b235-23d3d270cedb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.129423 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129259    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.129423 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129409    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-tmp\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.129818 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129430    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.129818 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129592    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f5a15af-3d20-4917-b235-23d3d270cedb-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-nfdqq\" (UID: \"9f5a15af-3d20-4917-b235-23d3d270cedb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.129818 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129799    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-snapshots\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.129934 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.129834    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-service-ca-bundle\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.131221 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.131197    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-serving-cert\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.131357 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.131337    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f5a15af-3d20-4917-b235-23d3d270cedb-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-nfdqq\" (UID: \"9f5a15af-3d20-4917-b235-23d3d270cedb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.136871 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.136847    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrch5\" (UniqueName: \"kubernetes.io/projected/9cb46a37-a646-4c80-9e62-1b7577f16f5b-kube-api-access-hrch5\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:11.137406 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.137376    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4v7w\" (UniqueName: \"kubernetes.io/projected/a51b4b84-4ec8-47f3-b939-51017ed10daf-kube-api-access-t4v7w\") pod \"volume-data-source-validator-78cf4c6f6-vs27r\" (UID: \"a51b4b84-4ec8-47f3-b939-51017ed10daf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r"
Jul 20 02:49:11.137600 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.137580    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6ll\" (UniqueName: \"kubernetes.io/projected/b7d6f323-62eb-4e28-add3-d8fb80de0bcc-kube-api-access-6n6ll\") pod \"insights-operator-555d9d7885-jspkh\" (UID: \"b7d6f323-62eb-4e28-add3-d8fb80de0bcc\") " pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.137683 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.137598    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5h9z\" (UniqueName: \"kubernetes.io/projected/9f5a15af-3d20-4917-b235-23d3d270cedb-kube-api-access-k5h9z\") pod \"kube-storage-version-migrator-operator-7658d9b749-nfdqq\" (UID: \"9f5a15af-3d20-4917-b235-23d3d270cedb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.165680 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.165629    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:11.216718 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.216630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:11.229089 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.229070    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r"
Jul 20 02:49:11.230358 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.230340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.230409 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.230375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.230442 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.230418    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-stats-auth\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.230523 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.230508    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:11.730490795 +0000 UTC m=+259.957259473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : configmap references non-existent config key: service-ca.crt
Jul 20 02:49:11.230586 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.230532    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f44mn\" (UniqueName: \"kubernetes.io/projected/35ca8fae-ee04-44bc-af17-fb63f987b537-kube-api-access-f44mn\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.230586 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.230545    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 02:49:11.230586 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.230556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.230743 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.230590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/42629dc9-3a3d-459a-9b9d-7bd58a785c80-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.230743 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.230604    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:11.730588935 +0000 UTC m=+259.957357625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : secret "router-metrics-certs-default" not found
Jul 20 02:49:11.230743 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.230650    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-default-certificate\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.230743 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.230674    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:11.230743 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.230684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjj5k\" (UniqueName: \"kubernetes.io/projected/42629dc9-3a3d-459a-9b9d-7bd58a785c80-kube-api-access-bjj5k\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.230743 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.230742    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls podName:42629dc9-3a3d-459a-9b9d-7bd58a785c80 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:11.730718427 +0000 UTC m=+259.957487120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-r4xh8" (UID: "42629dc9-3a3d-459a-9b9d-7bd58a785c80") : secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:11.231229 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.231207    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/42629dc9-3a3d-459a-9b9d-7bd58a785c80-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.235011 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.234987    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-stats-auth\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.235125 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.234997    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-default-certificate\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.237799 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.237768    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jspkh"
Jul 20 02:49:11.238743 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.238720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjj5k\" (UniqueName: \"kubernetes.io/projected/42629dc9-3a3d-459a-9b9d-7bd58a785c80-kube-api-access-bjj5k\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.238869 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.238852    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f44mn\" (UniqueName: \"kubernetes.io/projected/35ca8fae-ee04-44bc-af17-fb63f987b537-kube-api-access-f44mn\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.244299 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.244139    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"
Jul 20 02:49:11.368360 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.368231    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jspkh"]
Jul 20 02:49:11.371463 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:11.371422    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d6f323_62eb_4e28_add3_d8fb80de0bcc.slice/crio-20e66b24fb891d2074b7e434122dbd4bdfde1755bc433649fa7b9a3fabd8fd94 WatchSource:0}: Error finding container 20e66b24fb891d2074b7e434122dbd4bdfde1755bc433649fa7b9a3fabd8fd94: Status 404 returned error can't find the container with id 20e66b24fb891d2074b7e434122dbd4bdfde1755bc433649fa7b9a3fabd8fd94
Jul 20 02:49:11.383301 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.383278    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r"]
Jul 20 02:49:11.386412 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:11.386391    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51b4b84_4ec8_47f3_b939_51017ed10daf.slice/crio-e62e04111b02b593f98c0fa87768baaf7dc00ab23c5e436004b7c3d2c203ad6d WatchSource:0}: Error finding container e62e04111b02b593f98c0fa87768baaf7dc00ab23c5e436004b7c3d2c203ad6d: Status 404 returned error can't find the container with id e62e04111b02b593f98c0fa87768baaf7dc00ab23c5e436004b7c3d2c203ad6d
Jul 20 02:49:11.398056 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.398037    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq"]
Jul 20 02:49:11.401013 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:11.400969    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f5a15af_3d20_4917_b235_23d3d270cedb.slice/crio-0f2c0b469e1c7cfd6f233274c4cb0e78afa49faa09b0f31c5661dae513055bd7 WatchSource:0}: Error finding container 0f2c0b469e1c7cfd6f233274c4cb0e78afa49faa09b0f31c5661dae513055bd7: Status 404 returned error can't find the container with id 0f2c0b469e1c7cfd6f233274c4cb0e78afa49faa09b0f31c5661dae513055bd7
Jul 20 02:49:11.634838 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.634808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:11.635000 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.634954    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 02:49:11.635046 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.635013    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls podName:9cb46a37-a646-4c80-9e62-1b7577f16f5b nodeName:}" failed. No retries permitted until 2026-07-20 02:49:12.634997537 +0000 UTC m=+260.861766216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pnhj8" (UID: "9cb46a37-a646-4c80-9e62-1b7577f16f5b") : secret "samples-operator-tls" not found
Jul 20 02:49:11.735421 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.735390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:11.735597 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.735456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.735597 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:11.735492    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:11.735597 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.735553    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:11.735734 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.735615    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls podName:42629dc9-3a3d-459a-9b9d-7bd58a785c80 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:12.735601435 +0000 UTC m=+260.962370113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-r4xh8" (UID: "42629dc9-3a3d-459a-9b9d-7bd58a785c80") : secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:11.735734 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.735658    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:12.735623041 +0000 UTC m=+260.962391753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : configmap references non-existent config key: service-ca.crt
Jul 20 02:49:11.735734 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.735731    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 02:49:11.735846 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:11.735770    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:12.735757896 +0000 UTC m=+260.962526577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : secret "router-metrics-certs-default" not found
Jul 20 02:49:12.143923 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:12.143842    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jspkh" event={"ID":"b7d6f323-62eb-4e28-add3-d8fb80de0bcc","Type":"ContainerStarted","Data":"20e66b24fb891d2074b7e434122dbd4bdfde1755bc433649fa7b9a3fabd8fd94"}
Jul 20 02:49:12.145878 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:12.145844    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r" event={"ID":"a51b4b84-4ec8-47f3-b939-51017ed10daf","Type":"ContainerStarted","Data":"e62e04111b02b593f98c0fa87768baaf7dc00ab23c5e436004b7c3d2c203ad6d"}
Jul 20 02:49:12.147303 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:12.147280    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq" event={"ID":"9f5a15af-3d20-4917-b235-23d3d270cedb","Type":"ContainerStarted","Data":"0f2c0b469e1c7cfd6f233274c4cb0e78afa49faa09b0f31c5661dae513055bd7"}
Jul 20 02:49:12.643605 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:12.643576    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:12.643770 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:12.643749    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 02:49:12.643833 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:12.643825    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls podName:9cb46a37-a646-4c80-9e62-1b7577f16f5b nodeName:}" failed. No retries permitted until 2026-07-20 02:49:14.643805014 +0000 UTC m=+262.870573699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pnhj8" (UID: "9cb46a37-a646-4c80-9e62-1b7577f16f5b") : secret "samples-operator-tls" not found
Jul 20 02:49:12.744160 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:12.744121    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:12.744359 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:12.744174    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:12.744359 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:12.744233    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:12.744359 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:12.744311    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:14.744293803 +0000 UTC m=+262.971062485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : configmap references non-existent config key: service-ca.crt
Jul 20 02:49:12.744532 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:12.744372    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:12.744532 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:12.744377    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 02:49:12.744532 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:12.744427    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls podName:42629dc9-3a3d-459a-9b9d-7bd58a785c80 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:14.744412287 +0000 UTC m=+262.971180968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-r4xh8" (UID: "42629dc9-3a3d-459a-9b9d-7bd58a785c80") : secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:12.744532 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:12.744444    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:14.744435107 +0000 UTC m=+262.971203785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : secret "router-metrics-certs-default" not found
Jul 20 02:49:13.151056 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:13.151022    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r" event={"ID":"a51b4b84-4ec8-47f3-b939-51017ed10daf","Type":"ContainerStarted","Data":"b4e0f4b56e87657fbceb51f2debc18257df09069e7e3cc2176c7d365d1a2eed1"}
Jul 20 02:49:13.166307 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:13.166259    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vs27r" podStartSLOduration=1.9223163479999998 podStartE2EDuration="3.166243504s" totalImagesPullingTime="1.243927156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:13.164556456 +0000 UTC m=+261.391325180" watchObservedRunningTime="2026-07-20 02:49:13.166243504 +0000 UTC m=+261.393012205"
Jul 20 02:49:13.231993 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:13.231957    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:13.279171 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:13.279135    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:14.156564 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.156457    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq" event={"ID":"9f5a15af-3d20-4917-b235-23d3d270cedb","Type":"ContainerStarted","Data":"c811580a5ca89ba67d9ca9599eb44b98137f4b34b45fa24212763f355b96d2d8"}
Jul 20 02:49:14.158013 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.157987    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jspkh" event={"ID":"b7d6f323-62eb-4e28-add3-d8fb80de0bcc","Type":"ContainerStarted","Data":"4c153e9c9d08af6b806c059cb10b622af62a96666f210652388bb23b931da5a1"}
Jul 20 02:49:14.173561 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.173484    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq" podStartSLOduration=1.7656178740000001 podStartE2EDuration="4.173465524s" totalImagesPullingTime="2.40784765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:14.172702993 +0000 UTC m=+262.399471692" watchObservedRunningTime="2026-07-20 02:49:14.173465524 +0000 UTC m=+262.400234225"
Jul 20 02:49:14.187608 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.187559    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-jspkh" podStartSLOduration=1.753135678 podStartE2EDuration="4.187542117s" totalImagesPullingTime="2.434406439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:14.185762548 +0000 UTC m=+262.412531251" watchObservedRunningTime="2026-07-20 02:49:14.187542117 +0000 UTC m=+262.414310815"
Jul 20 02:49:14.588597 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.588567    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jpw9n"]
Jul 20 02:49:14.591949 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.591924    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.593982 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.593959    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 02:49:14.593982 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.593974    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 02:49:14.594151 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.593978    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kg8wf\""
Jul 20 02:49:14.608924 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.608897    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpw9n"]
Jul 20 02:49:14.631694 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.631663    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:14.661028 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.660980    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mbhn\" (UniqueName: \"kubernetes.io/projected/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-api-access-7mbhn\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.661161 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.661050    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-crio-socket\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.661161 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.661120    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.661161 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.661142    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:14.661280 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.661164    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-data-volume\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.661280 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.661244    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.661511 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.661279    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 02:49:14.661511 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.661329    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls podName:9cb46a37-a646-4c80-9e62-1b7577f16f5b nodeName:}" failed. No retries permitted until 2026-07-20 02:49:18.661314139 +0000 UTC m=+266.888082817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pnhj8" (UID: "9cb46a37-a646-4c80-9e62-1b7577f16f5b") : secret "samples-operator-tls" not found
Jul 20 02:49:14.701796 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.701765    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:14.762580 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.762544    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:14.762580 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.762582    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-crio-socket\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.762821 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.762675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:14.762821 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.762707    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.762821 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.762715    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 02:49:14.762821 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.762748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-data-volume\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.762821 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.762762    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-crio-socket\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.762821 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.762777    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:18.762758065 +0000 UTC m=+266.989526749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : secret "router-metrics-certs-default" not found
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.762847    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.762885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.762905    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls podName:42629dc9-3a3d-459a-9b9d-7bd58a785c80 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:18.762888897 +0000 UTC m=+266.989657588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-r4xh8" (UID: "42629dc9-3a3d-459a-9b9d-7bd58a785c80") : secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.762853    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.762939    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.762962    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:18.76295158 +0000 UTC m=+266.989720278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : configmap references non-existent config key: service-ca.crt
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.762982    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:15.262973521 +0000 UTC m=+263.489742215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.762985    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.763009    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mbhn\" (UniqueName: \"kubernetes.io/projected/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-api-access-7mbhn\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.763043 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:14.763016    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:15.263006513 +0000 UTC m=+263.489775194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : configmap "kube-rbac-proxy" not found
Jul 20 02:49:14.763468 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.763046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-data-volume\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.769673 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.769628    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mbhn\" (UniqueName: \"kubernetes.io/projected/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-api-access-7mbhn\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:14.795175 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.795149    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:14.895755 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:14.895666    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:15.253855 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.253776    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:15.267916 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.267892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:15.268067 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.268037    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:15.268225 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:15.268204    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 02:49:15.268327 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:15.268268    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:16.268251314 +0000 UTC m=+264.495019998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : configmap "kube-rbac-proxy" not found
Jul 20 02:49:15.268327 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:15.268294    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:15.268406 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:15.268368    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:16.268349782 +0000 UTC m=+264.495118471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:15.354592 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.354567    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:15.677256 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.677211    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:15.719782 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.719754    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm"]
Jul 20 02:49:15.722837 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.722816    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm"
Jul 20 02:49:15.725085 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.725064    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 20 02:49:15.725188 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.725161    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pvlwb\""
Jul 20 02:49:15.725778 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.725761    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 20 02:49:15.730107 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.730087    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm"]
Jul 20 02:49:15.780155 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.780130    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:15.872294 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.872264    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l8vl\" (UniqueName: \"kubernetes.io/projected/d4024cf1-1c72-4b59-8771-f44de5c7188f-kube-api-access-9l8vl\") pod \"migrator-7cc9c7ffd7-m98qm\" (UID: \"d4024cf1-1c72-4b59-8771-f44de5c7188f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm"
Jul 20 02:49:15.880984 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.880936    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:15.973227 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.973171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l8vl\" (UniqueName: \"kubernetes.io/projected/d4024cf1-1c72-4b59-8771-f44de5c7188f-kube-api-access-9l8vl\") pod \"migrator-7cc9c7ffd7-m98qm\" (UID: \"d4024cf1-1c72-4b59-8771-f44de5c7188f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm"
Jul 20 02:49:15.980393 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.980369    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l8vl\" (UniqueName: \"kubernetes.io/projected/d4024cf1-1c72-4b59-8771-f44de5c7188f-kube-api-access-9l8vl\") pod \"migrator-7cc9c7ffd7-m98qm\" (UID: \"d4024cf1-1c72-4b59-8771-f44de5c7188f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm"
Jul 20 02:49:15.980537 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:15.980475    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:16.028802 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:16.028777    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:16.031885 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:16.031871    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm"
Jul 20 02:49:16.148528 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:16.148495    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm"]
Jul 20 02:49:16.151547 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:16.151523    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4024cf1_1c72_4b59_8771_f44de5c7188f.slice/crio-3248f1b19b2afa3fd050a0077290a2a981d43e19e4d0112db4f09bdb0f7342d1 WatchSource:0}: Error finding container 3248f1b19b2afa3fd050a0077290a2a981d43e19e4d0112db4f09bdb0f7342d1: Status 404 returned error can't find the container with id 3248f1b19b2afa3fd050a0077290a2a981d43e19e4d0112db4f09bdb0f7342d1
Jul 20 02:49:16.165036 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:16.164992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm" event={"ID":"d4024cf1-1c72-4b59-8771-f44de5c7188f","Type":"ContainerStarted","Data":"3248f1b19b2afa3fd050a0077290a2a981d43e19e4d0112db4f09bdb0f7342d1"}
Jul 20 02:49:16.275868 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:16.275803    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:16.276262 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:16.275875    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:16.276262 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:16.275959    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:16.276262 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:16.275983    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 02:49:16.276262 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:16.276033    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:18.276013107 +0000 UTC m=+266.502781795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:16.276262 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:16.276052    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:18.276042985 +0000 UTC m=+266.502811665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : configmap "kube-rbac-proxy" not found
Jul 20 02:49:16.782972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:16.782945    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vpdbw_225e9e97-1891-45b6-a07c-9757e8e87138/dns-node-resolver/0.log"
Jul 20 02:49:17.580019 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:17.579945    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:17.582410 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:17.582397    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kv9sm_6fb1844f-0bb1-4982-b830-39500f72b0ef/node-ca/0.log"
Jul 20 02:49:17.631049 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:17.631016    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:18.172385 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.172347    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm" event={"ID":"d4024cf1-1c72-4b59-8771-f44de5c7188f","Type":"ContainerStarted","Data":"9a5a048bb0afc7feafd4a3d31077ea01d9955b139dcdd6f3de11064ee2aa29cc"}
Jul 20 02:49:18.172539 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.172404    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm" event={"ID":"d4024cf1-1c72-4b59-8771-f44de5c7188f","Type":"ContainerStarted","Data":"f17983449dddfdbbeb7e8798a0f771af89f911d79d57c4b3f7f1f43aa2c0ffe3"}
Jul 20 02:49:18.186823 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.186779    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m98qm" podStartSLOduration=2.03949163 podStartE2EDuration="3.186763877s" totalImagesPullingTime="1.147272247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:18.186235005 +0000 UTC m=+266.413003696" watchObservedRunningTime="2026-07-20 02:49:18.186763877 +0000 UTC m=+266.413532576"
Jul 20 02:49:18.292571 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.292540    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:18.292740 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.292627    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:18.292740 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.292663    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 02:49:18.292740 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.292718    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:22.292704469 +0000 UTC m=+270.519473147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : configmap "kube-rbac-proxy" not found
Jul 20 02:49:18.292849 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.292745    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:18.292849 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.292790    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:22.292773893 +0000 UTC m=+270.519542571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:18.383504 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.383473    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lcdxk_6dff67a4-0a44-4ab9-8614-ca174b41e699/serve-healthcheck-canary/0.log"
Jul 20 02:49:18.397031 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.396992    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:18.696974 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.696942    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:18.697374 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.697106    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 02:49:18.697374 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.697177    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls podName:9cb46a37-a646-4c80-9e62-1b7577f16f5b nodeName:}" failed. No retries permitted until 2026-07-20 02:49:26.697162255 +0000 UTC m=+274.923930933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pnhj8" (UID: "9cb46a37-a646-4c80-9e62-1b7577f16f5b") : secret "samples-operator-tls" not found
Jul 20 02:49:18.798425 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.798390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:18.798625 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.798456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:18.798625 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:18.798515    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:18.798625 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.798560    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 02:49:18.798625 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.798596    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:18.798625 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.798608    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:26.798595992 +0000 UTC m=+275.025364670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : configmap references non-existent config key: service-ca.crt
Jul 20 02:49:18.798625 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.798622    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs podName:35ca8fae-ee04-44bc-af17-fb63f987b537 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:26.798615016 +0000 UTC m=+275.025383694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs") pod "router-default-67656b96-dhf9s" (UID: "35ca8fae-ee04-44bc-af17-fb63f987b537") : secret "router-metrics-certs-default" not found
Jul 20 02:49:18.798875 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:18.798633    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls podName:42629dc9-3a3d-459a-9b9d-7bd58a785c80 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:26.798627089 +0000 UTC m=+275.025395767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-r4xh8" (UID: "42629dc9-3a3d-459a-9b9d-7bd58a785c80") : secret "cluster-monitoring-operator-tls" not found
Jul 20 02:49:19.213206 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:19.213176    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:19.324958 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:19.324926    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:19.413580 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:19.413547    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:19.514610 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:19.514528    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:19.715197 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:19.715160    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:19.915626 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:19.915598    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:21.113907 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:21.113851    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:21.309573 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:21.309544    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:21.414294 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:21.414203    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:21.518158 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:21.518130    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:21.722401 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:21.722322    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:21.914266 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:21.914224    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:22.328689 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:22.328650    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:22.329091 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:22.328729    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:22.329091 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:22.328803    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:22.329091 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:22.328822    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 02:49:22.329091 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:22.328864    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:30.328848956 +0000 UTC m=+278.555617634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : secret "insights-runtime-extractor-tls" not found
Jul 20 02:49:22.329091 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:22.328879    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm podName:dd3a7e3f-385a-41d9-b3be-9769fe107b3f nodeName:}" failed. No retries permitted until 2026-07-20 02:49:30.328872714 +0000 UTC m=+278.555641392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpw9n" (UID: "dd3a7e3f-385a-41d9-b3be-9769fe107b3f") : configmap "kube-rbac-proxy" not found
Jul 20 02:49:22.931607 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:22.931564    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:23.109750 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:23.109715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:23.167865 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:23.167834    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:23.312540 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:23.312512    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:23.515807 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:23.515775    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:23.709626 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:23.709548    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:23.911389 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:23.911349    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:24.692653 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:24.692603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:24.916239 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:24.916201    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:25.113300 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:25.113249    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:25.510379 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:25.510304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:25.713333 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:25.713301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:25.761218 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:25.761146    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:26.309101 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.309043    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:26.766034 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.765944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:26.768357 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.768336    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cb46a37-a646-4c80-9e62-1b7577f16f5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pnhj8\" (UID: \"9cb46a37-a646-4c80-9e62-1b7577f16f5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:26.851386 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.851343    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"
Jul 20 02:49:26.866666 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.866610    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:26.866784 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.866737    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:26.866845 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.866829    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:26.867550 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.867526    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35ca8fae-ee04-44bc-af17-fb63f987b537-service-ca-bundle\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:26.869029 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.869002    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35ca8fae-ee04-44bc-af17-fb63f987b537-metrics-certs\") pod \"router-default-67656b96-dhf9s\" (UID: \"35ca8fae-ee04-44bc-af17-fb63f987b537\") " pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:26.869176 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.869157    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/42629dc9-3a3d-459a-9b9d-7bd58a785c80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-r4xh8\" (UID: \"42629dc9-3a3d-459a-9b9d-7bd58a785c80\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:26.908020 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.907989    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:26.939886 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.939858    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"
Jul 20 02:49:26.946131 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.946088    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:26.972662 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:26.972369    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8"]
Jul 20 02:49:27.071546 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.071510    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8"]
Jul 20 02:49:27.075352 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:27.075324    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42629dc9_3a3d_459a_9b9d_7bd58a785c80.slice/crio-2bb6053c188951fbbdbb4ce225c119c0b7a866909b44c98d0f85144fd8dc202a WatchSource:0}: Error finding container 2bb6053c188951fbbdbb4ce225c119c0b7a866909b44c98d0f85144fd8dc202a: Status 404 returned error can't find the container with id 2bb6053c188951fbbdbb4ce225c119c0b7a866909b44c98d0f85144fd8dc202a
Jul 20 02:49:27.091118 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.091089    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67656b96-dhf9s"]
Jul 20 02:49:27.093896 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:27.093865    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ca8fae_ee04_44bc_af17_fb63f987b537.slice/crio-52abbb452a04fca6cc771cee9eb59436c30791b037a53d6ef034a9031527c136 WatchSource:0}: Error finding container 52abbb452a04fca6cc771cee9eb59436c30791b037a53d6ef034a9031527c136: Status 404 returned error can't find the container with id 52abbb452a04fca6cc771cee9eb59436c30791b037a53d6ef034a9031527c136
Jul 20 02:49:27.108439 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.108396    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:27.200756 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.200724    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67656b96-dhf9s" event={"ID":"35ca8fae-ee04-44bc-af17-fb63f987b537","Type":"ContainerStarted","Data":"afc6efaf76284c623fa2bf54f754789fbaf04a3b22fed89764592dd704ce519d"}
Jul 20 02:49:27.200933 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.200775    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67656b96-dhf9s" event={"ID":"35ca8fae-ee04-44bc-af17-fb63f987b537","Type":"ContainerStarted","Data":"52abbb452a04fca6cc771cee9eb59436c30791b037a53d6ef034a9031527c136"}
Jul 20 02:49:27.201853 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.201829    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8" event={"ID":"42629dc9-3a3d-459a-9b9d-7bd58a785c80","Type":"ContainerStarted","Data":"2bb6053c188951fbbdbb4ce225c119c0b7a866909b44c98d0f85144fd8dc202a"}
Jul 20 02:49:27.202740 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.202719    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8" event={"ID":"9cb46a37-a646-4c80-9e62-1b7577f16f5b","Type":"ContainerStarted","Data":"c2d952908a22a7e4d09e47fdb3bb7fc763bc955d21d40317de8681fcc3c65aed"}
Jul 20 02:49:27.216446 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.216407    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67656b96-dhf9s" podStartSLOduration=16.216391919 podStartE2EDuration="16.216391919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:27.215560026 +0000 UTC m=+275.442328728" watchObservedRunningTime="2026-07-20 02:49:27.216391919 +0000 UTC m=+275.443160618"
Jul 20 02:49:27.509838 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.509803    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:27.710234 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.710200    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:27.812546 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.812505    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:27.913362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.913303    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:27.946867 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.946794    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:27.949611 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:27.949588    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:28.207434 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:28.207304    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:28.208849 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:28.208825    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67656b96-dhf9s"
Jul 20 02:49:28.764877 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:28.764846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:28.815252 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:28.815197    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:29.110316 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:29.110281    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:29.306546 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:29.306525    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:29.550043 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:29.550011    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:29.649957 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:29.649880    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:29.750846 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:29.750815    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:29.800173 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:29.800145    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:29.914606 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:29.914526    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:30.214604 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.214513    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8" event={"ID":"42629dc9-3a3d-459a-9b9d-7bd58a785c80","Type":"ContainerStarted","Data":"ee8726051e10c8c5d4ae99ad743a5a6d805c12e5a224b37383ff5f402650ed12"}
Jul 20 02:49:30.216262 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.216234    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8" event={"ID":"9cb46a37-a646-4c80-9e62-1b7577f16f5b","Type":"ContainerStarted","Data":"bb04d0bc49a00caa100d2e44f838d644eb7bc3fc3caba46a8c972ff72fe02eef"}
Jul 20 02:49:30.216370 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.216284    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8" event={"ID":"9cb46a37-a646-4c80-9e62-1b7577f16f5b","Type":"ContainerStarted","Data":"a8f1e0a87038d5c7dbe6bedc055b3dda5746a7efbf4fdbe7ef66cae290c8a7dd"}
Jul 20 02:49:30.231763 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.231723    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-r4xh8" podStartSLOduration=17.040475087 podStartE2EDuration="19.231710445s" totalImagesPullingTime="2.191235358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:30.230719698 +0000 UTC m=+278.457488419" watchObservedRunningTime="2026-07-20 02:49:30.231710445 +0000 UTC m=+278.458479143"
Jul 20 02:49:30.244656 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.244607    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pnhj8" podStartSLOduration=18.002910141 podStartE2EDuration="20.244593571s" totalImagesPullingTime="2.24168343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:30.243732687 +0000 UTC m=+278.470501412" watchObservedRunningTime="2026-07-20 02:49:30.244593571 +0000 UTC m=+278.471362332"
Jul 20 02:49:30.312215 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.312181    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:30.398957 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.398922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:30.399538 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.399208    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:30.399711 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.399693    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:30.401390 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.401369    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd3a7e3f-385a-41d9-b3be-9769fe107b3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpw9n\" (UID: \"dd3a7e3f-385a-41d9-b3be-9769fe107b3f\") " pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:30.500587 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.500503    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpw9n"
Jul 20 02:49:30.620929 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:30.620893    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpw9n"]
Jul 20 02:49:30.624603 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:30.624576    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd3a7e3f_385a_41d9_b3be_9769fe107b3f.slice/crio-acd6c5ce0eb4ef44f521725216eb48ba2628b54594ecd9e839344ac972ef56ce WatchSource:0}: Error finding container acd6c5ce0eb4ef44f521725216eb48ba2628b54594ecd9e839344ac972ef56ce: Status 404 returned error can't find the container with id acd6c5ce0eb4ef44f521725216eb48ba2628b54594ecd9e839344ac972ef56ce
Jul 20 02:49:31.223918 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:31.223879    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpw9n" event={"ID":"dd3a7e3f-385a-41d9-b3be-9769fe107b3f","Type":"ContainerStarted","Data":"acd6c5ce0eb4ef44f521725216eb48ba2628b54594ecd9e839344ac972ef56ce"}
Jul 20 02:49:35.918114 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:35.918069    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx" podUID="2e4e21eb-855e-4a48-8424-5d9d4791a858"
Jul 20 02:49:35.918663 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:35.918069    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76c5564449-659jx" podUID="daf110bc-f49b-4a57-bca9-ff688ce7d3ca"
Jul 20 02:49:35.918663 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:35.918073    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bnqc8" podUID="83c8b733-cd7c-47e5-b02a-30d52a36766a"
Jul 20 02:49:36.132547 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.132468    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:36.229925 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.229816    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:36.249965 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.249935    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:49:36.249965 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.249953    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:49:36.250171 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.249927    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpw9n" event={"ID":"dd3a7e3f-385a-41d9-b3be-9769fe107b3f","Type":"ContainerStarted","Data":"effae02c5d9fd260d9815fc6d6851292c023af29043f897d8f29c35c0317fd99"}
Jul 20 02:49:36.250171 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.250112    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:49:36.440126 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.440094    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-87jzx"]
Jul 20 02:49:36.443386 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.443362    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-87jzx"
Jul 20 02:49:36.445227 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.445203    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 02:49:36.445326 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.445203    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-flfw5\""
Jul 20 02:49:36.445379 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.445324    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 02:49:36.448998 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.448971    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:36.451627 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.450992    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8bjl\" (UniqueName: \"kubernetes.io/projected/0d9a255a-7ec0-44dc-a7e0-c34b00328c8a-kube-api-access-c8bjl\") pod \"downloads-5bc67dcd46-87jzx\" (UID: \"0d9a255a-7ec0-44dc-a7e0-c34b00328c8a\") " pod="openshift-console/downloads-5bc67dcd46-87jzx"
Jul 20 02:49:36.452515 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.452492    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-87jzx"]
Jul 20 02:49:36.506301 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.506174    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:36.551436 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.551399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8bjl\" (UniqueName: \"kubernetes.io/projected/0d9a255a-7ec0-44dc-a7e0-c34b00328c8a-kube-api-access-c8bjl\") pod \"downloads-5bc67dcd46-87jzx\" (UID: \"0d9a255a-7ec0-44dc-a7e0-c34b00328c8a\") " pod="openshift-console/downloads-5bc67dcd46-87jzx"
Jul 20 02:49:36.558722 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.558687    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:36.559798 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.559777    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8bjl\" (UniqueName: \"kubernetes.io/projected/0d9a255a-7ec0-44dc-a7e0-c34b00328c8a-kube-api-access-c8bjl\") pod \"downloads-5bc67dcd46-87jzx\" (UID: \"0d9a255a-7ec0-44dc-a7e0-c34b00328c8a\") " pod="openshift-console/downloads-5bc67dcd46-87jzx"
Jul 20 02:49:36.728251 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.728213    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:36.755755 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.755729    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-87jzx"
Jul 20 02:49:36.935917 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.935883    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:36.987573 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:36.987523    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:37.123129 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:37.123078    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:37.223512 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:37.223454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:38.320564 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:38.320528    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:38.513208 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:38.513174    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:38.565219 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:38.565174    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:38.766362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:38.766335    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-87jzx"]
Jul 20 02:49:38.770571 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:38.770545    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9a255a_7ec0_44dc_a7e0_c34b00328c8a.slice/crio-f1efd60aab5579d243bf944fc25a48a677e6cf42806160f5bc495bd7aab8a7c2 WatchSource:0}: Error finding container f1efd60aab5579d243bf944fc25a48a677e6cf42806160f5bc495bd7aab8a7c2: Status 404 returned error can't find the container with id f1efd60aab5579d243bf944fc25a48a677e6cf42806160f5bc495bd7aab8a7c2
Jul 20 02:49:39.136847 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.136775    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:39.261444 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.261409    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpw9n" event={"ID":"dd3a7e3f-385a-41d9-b3be-9769fe107b3f","Type":"ContainerStarted","Data":"02d8bdd42042f3d4a4a269dcc6356ee5730bf1f514b3b5abb7fa506f4a37df33"}
Jul 20 02:49:39.262478 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.262459    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-87jzx" event={"ID":"0d9a255a-7ec0-44dc-a7e0-c34b00328c8a","Type":"ContainerStarted","Data":"f1efd60aab5579d243bf944fc25a48a677e6cf42806160f5bc495bd7aab8a7c2"}
Jul 20 02:49:39.573335 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.572744    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:49:39.573335 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.572800    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:49:39.573335 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.572903    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:49:39.575628 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.575593    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c8b733-cd7c-47e5-b02a-30d52a36766a-metrics-tls\") pod \"dns-default-bnqc8\" (UID: \"83c8b733-cd7c-47e5-b02a-30d52a36766a\") " pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:49:39.576680 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.576655    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4e21eb-855e-4a48-8424-5d9d4791a858-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sxpjx\" (UID: \"2e4e21eb-855e-4a48-8424-5d9d4791a858\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:49:39.577312 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.577284    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"image-registry-76c5564449-659jx\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") " pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:49:39.785413 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.785346    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:39.833276 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.833147    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"]
Jul 20 02:49:39.836844 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.836777    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.839928 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.839866    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 02:49:39.840761 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.840459    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 02:49:39.840761 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.840500    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 02:49:39.840761 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.840528    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4rqjc\""
Jul 20 02:49:39.853765 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.853742    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bj7p5\""
Jul 20 02:49:39.854388 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.854299    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwwjm\""
Jul 20 02:49:39.854668 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.854651    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nz45m\""
Jul 20 02:49:39.856933 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.856540    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"]
Jul 20 02:49:39.862211 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.862044    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:49:39.862211 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.862099    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"
Jul 20 02:49:39.862211 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.862167    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:49:39.874918 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.874890    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd050399-cbce-4493-8c9d-77c8271b3736-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.875020 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.874944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd050399-cbce-4493-8c9d-77c8271b3736-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.876404 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.876377    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd050399-cbce-4493-8c9d-77c8271b3736-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.876474 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.876417    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk9hn\" (UniqueName: \"kubernetes.io/projected/dd050399-cbce-4493-8c9d-77c8271b3736-kube-api-access-sk9hn\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.880680 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.880656    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:39.977559 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.977527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd050399-cbce-4493-8c9d-77c8271b3736-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.977740 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.977571    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk9hn\" (UniqueName: \"kubernetes.io/projected/dd050399-cbce-4493-8c9d-77c8271b3736-kube-api-access-sk9hn\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.977740 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.977610    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd050399-cbce-4493-8c9d-77c8271b3736-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.977740 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.977663    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd050399-cbce-4493-8c9d-77c8271b3736-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.977910 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:39.977778    2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 20 02:49:39.977910 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:39.977854    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd050399-cbce-4493-8c9d-77c8271b3736-prometheus-operator-tls podName:dd050399-cbce-4493-8c9d-77c8271b3736 nodeName:}" failed. No retries permitted until 2026-07-20 02:49:40.477833424 +0000 UTC m=+288.704602120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/dd050399-cbce-4493-8c9d-77c8271b3736-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-tm67p" (UID: "dd050399-cbce-4493-8c9d-77c8271b3736") : secret "prometheus-operator-tls" not found
Jul 20 02:49:39.978350 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.978323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd050399-cbce-4493-8c9d-77c8271b3736-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.980450 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.980427    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd050399-cbce-4493-8c9d-77c8271b3736-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:39.989534 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:39.989492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk9hn\" (UniqueName: \"kubernetes.io/projected/dd050399-cbce-4493-8c9d-77c8271b3736-kube-api-access-sk9hn\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:40.048602 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.041935    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76c5564449-659jx"]
Jul 20 02:49:40.048602 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:40.048414    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf110bc_f49b_4a57_bca9_ff688ce7d3ca.slice/crio-c579c076efdb7c8ac9beafef4651f8f2212e9ebd3ad0d8465468b10039e949f3 WatchSource:0}: Error finding container c579c076efdb7c8ac9beafef4651f8f2212e9ebd3ad0d8465468b10039e949f3: Status 404 returned error can't find the container with id c579c076efdb7c8ac9beafef4651f8f2212e9ebd3ad0d8465468b10039e949f3
Jul 20 02:49:40.058494 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.058427    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx"]
Jul 20 02:49:40.082063 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.082041    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bnqc8"]
Jul 20 02:49:40.091051 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:40.091018    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c8b733_cd7c_47e5_b02a_30d52a36766a.slice/crio-7a017daa679650df1d8886cc9bcbc128ab934cd838c6b4e9f1a1e311639765b2 WatchSource:0}: Error finding container 7a017daa679650df1d8886cc9bcbc128ab934cd838c6b4e9f1a1e311639765b2: Status 404 returned error can't find the container with id 7a017daa679650df1d8886cc9bcbc128ab934cd838c6b4e9f1a1e311639765b2
Jul 20 02:49:40.271772 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.271732    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx" event={"ID":"2e4e21eb-855e-4a48-8424-5d9d4791a858","Type":"ContainerStarted","Data":"b71e6f301f348e6f33e4b3417fed90409de9362760e061ae043f92d4fe712311"}
Jul 20 02:49:40.279275 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.279251    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:49:40.279447 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.279302    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c5564449-659jx" event={"ID":"daf110bc-f49b-4a57-bca9-ff688ce7d3ca","Type":"ContainerStarted","Data":"1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781"}
Jul 20 02:49:40.279447 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.279328    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c5564449-659jx" event={"ID":"daf110bc-f49b-4a57-bca9-ff688ce7d3ca","Type":"ContainerStarted","Data":"c579c076efdb7c8ac9beafef4651f8f2212e9ebd3ad0d8465468b10039e949f3"}
Jul 20 02:49:40.279447 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.279347    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnqc8" event={"ID":"83c8b733-cd7c-47e5-b02a-30d52a36766a","Type":"ContainerStarted","Data":"7a017daa679650df1d8886cc9bcbc128ab934cd838c6b4e9f1a1e311639765b2"}
Jul 20 02:49:40.294881 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.294475    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76c5564449-659jx" podStartSLOduration=287.29445758 podStartE2EDuration="4m47.29445758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:40.294163556 +0000 UTC m=+288.520932260" watchObservedRunningTime="2026-07-20 02:49:40.29445758 +0000 UTC m=+288.521226281"
Jul 20 02:49:40.339111 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.339050    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:40.482953 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.482854    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd050399-cbce-4493-8c9d-77c8271b3736-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:40.485984 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.485953    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd050399-cbce-4493-8c9d-77c8271b3736-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tm67p\" (UID: \"dd050399-cbce-4493-8c9d-77c8271b3736\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:40.749661 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.749570    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"
Jul 20 02:49:40.941692 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:40.941660    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tm67p"]
Jul 20 02:49:40.942977 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:40.942948    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd050399_cbce_4493_8c9d_77c8271b3736.slice/crio-b9c42261a7d0a01e3cf1a0aa91462d2ebf535d949bde9ee6f047cda31a0d8e43 WatchSource:0}: Error finding container b9c42261a7d0a01e3cf1a0aa91462d2ebf535d949bde9ee6f047cda31a0d8e43: Status 404 returned error can't find the container with id b9c42261a7d0a01e3cf1a0aa91462d2ebf535d949bde9ee6f047cda31a0d8e43
Jul 20 02:49:41.284782 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:41.284743    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p" event={"ID":"dd050399-cbce-4493-8c9d-77c8271b3736","Type":"ContainerStarted","Data":"b9c42261a7d0a01e3cf1a0aa91462d2ebf535d949bde9ee6f047cda31a0d8e43"}
Jul 20 02:49:43.760995 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:43.760961    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:43.861240 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:43.861164    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:44.884357 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:44.884326    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:45.302395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.302356    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpw9n" event={"ID":"dd3a7e3f-385a-41d9-b3be-9769fe107b3f","Type":"ContainerStarted","Data":"fc99e46e67affb3813f56273ed0e7f1cf3d145f02eb578d8e00ac6d433e5f3e1"}
Jul 20 02:49:45.304208 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.304176    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnqc8" event={"ID":"83c8b733-cd7c-47e5-b02a-30d52a36766a","Type":"ContainerStarted","Data":"60778ddd804a535fc4e6823e6ba309fdd9749599f6ef74a4e501c0021dd6281a"}
Jul 20 02:49:45.304333 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.304229    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnqc8" event={"ID":"83c8b733-cd7c-47e5-b02a-30d52a36766a","Type":"ContainerStarted","Data":"6ab3b1398baa7292d694477b56e50c4eac6b5b5a95256d78a4bcba9d43e1f638"}
Jul 20 02:49:45.304333 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.304256    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:49:45.305912 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.305888    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p" event={"ID":"dd050399-cbce-4493-8c9d-77c8271b3736","Type":"ContainerStarted","Data":"70a0d019bbcf7c41e45b5615b5318334a914abf957c25ccdaeaabe4dcd4d5a26"}
Jul 20 02:49:45.306005 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.305928    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p" event={"ID":"dd050399-cbce-4493-8c9d-77c8271b3736","Type":"ContainerStarted","Data":"11725dae38663721cd75f24caa89f5b17fcffc3f679ab365d1a8023ac8ccea15"}
Jul 20 02:49:45.307330 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.307309    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx" event={"ID":"2e4e21eb-855e-4a48-8424-5d9d4791a858","Type":"ContainerStarted","Data":"1b37a53b895815be9deb1e3a90b2401f70e2b99ab8c941256aa69e3c47e0e976"}
Jul 20 02:49:45.335911 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.335868    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jpw9n" podStartSLOduration=17.572061775 podStartE2EDuration="31.335853997s" totalImagesPullingTime="13.763792222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 02:49:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:45.335217154 +0000 UTC m=+293.561985878" watchObservedRunningTime="2026-07-20 02:49:45.335853997 +0000 UTC m=+293.562622695"
Jul 20 02:49:45.356649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.356596    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sxpjx" podStartSLOduration=272.902169217 podStartE2EDuration="4m37.35657677s" totalImagesPullingTime="4.454407553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:45.355793495 +0000 UTC m=+293.582562224" watchObservedRunningTime="2026-07-20 02:49:45.35657677 +0000 UTC m=+293.583345473"
Jul 20 02:49:45.393790 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.393727    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bnqc8" podStartSLOduration=251.966639228 podStartE2EDuration="4m16.393706799s" totalImagesPullingTime="4.427067571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:45.393081822 +0000 UTC m=+293.619850523" watchObservedRunningTime="2026-07-20 02:49:45.393706799 +0000 UTC m=+293.620475492"
Jul 20 02:49:45.394047 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.394017    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tm67p" podStartSLOduration=2.768740311 podStartE2EDuration="6.39400915s" totalImagesPullingTime="3.625268839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:45.371899713 +0000 UTC m=+293.598668415" watchObservedRunningTime="2026-07-20 02:49:45.39400915 +0000 UTC m=+293.620777850"
Jul 20 02:49:45.469450 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.469400    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:45.526758 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:45.526721    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:46.921397 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:46.921234    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:47.181250 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.181170    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:47.236115 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.236084    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t9n29"]
Jul 20 02:49:47.241023 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.240996    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.243349 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.243324    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 02:49:47.243613 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.243377    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 02:49:47.243613 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.243421    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z7hth\""
Jul 20 02:49:47.243613 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.243481    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 02:49:47.272674 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.272590    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:47.335160 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.335128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:47.349238 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.349212    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.349362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.349261    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aefd175-49cf-4963-8ebb-36e238849ae1-metrics-client-ca\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.349362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.349313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.349600 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.349358    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-textfile\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.349600 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.349389    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-tls\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.349600 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.349417    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-wtmp\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.349600 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.349446    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7aefd175-49cf-4963-8ebb-36e238849ae1-root\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.349600 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.349469    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aefd175-49cf-4963-8ebb-36e238849ae1-sys\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.349600 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.349496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkfwj\" (UniqueName: \"kubernetes.io/projected/7aefd175-49cf-4963-8ebb-36e238849ae1-kube-api-access-jkfwj\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.435393 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.435319    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:47.450441 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.450589 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aefd175-49cf-4963-8ebb-36e238849ae1-metrics-client-ca\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.450670 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450612    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.450738 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-textfile\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.450738 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450691    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-tls\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.450738 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-wtmp\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.450888 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7aefd175-49cf-4963-8ebb-36e238849ae1-root\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.450888 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450776    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aefd175-49cf-4963-8ebb-36e238849ae1-sys\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.450888 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450824    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkfwj\" (UniqueName: \"kubernetes.io/projected/7aefd175-49cf-4963-8ebb-36e238849ae1-kube-api-access-jkfwj\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.451032 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450912    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-wtmp\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.451126 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.451107    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-textfile\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.451200 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.451168    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aefd175-49cf-4963-8ebb-36e238849ae1-sys\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.451338 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.451309    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aefd175-49cf-4963-8ebb-36e238849ae1-metrics-client-ca\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.451446 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.450971    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7aefd175-49cf-4963-8ebb-36e238849ae1-root\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.451518 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.451441    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.453250 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.453227    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.453441 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.453424    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aefd175-49cf-4963-8ebb-36e238849ae1-node-exporter-tls\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.458131 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.458107    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkfwj\" (UniqueName: \"kubernetes.io/projected/7aefd175-49cf-4963-8ebb-36e238849ae1-kube-api-access-jkfwj\") pod \"node-exporter-t9n29\" (UID: \"7aefd175-49cf-4963-8ebb-36e238849ae1\") " pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.535529 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.535466    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:47.552648 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.552610    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9n29"
Jul 20 02:49:47.570254 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:47.570225    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aefd175_49cf_4963_8ebb_36e238849ae1.slice/crio-b087618d31ae5121fce880c25212f0ce3b72703422951bf81fd023fb9035f2a9 WatchSource:0}: Error finding container b087618d31ae5121fce880c25212f0ce3b72703422951bf81fd023fb9035f2a9: Status 404 returned error can't find the container with id b087618d31ae5121fce880c25212f0ce3b72703422951bf81fd023fb9035f2a9
Jul 20 02:49:47.645201 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.645160    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:47.743453 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:47.743366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:48.007910 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.007832    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:48.149522 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.149487    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:48.257688 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.257659    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:48.271484 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.271420    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 02:49:48.300986 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.300958    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.304041 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.304014    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 02:49:48.304490 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.304470    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 02:49:48.304710 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.304693    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 02:49:48.304872 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.304856    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 02:49:48.305714 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.305693    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sjgnw\""
Jul 20 02:49:48.305920 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.305902    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 02:49:48.306094 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.306078    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 02:49:48.306160 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.306104    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 02:49:48.306324 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.306307    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 02:49:48.306395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.306363    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 02:49:48.309825 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.309803    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 02:49:48.326070 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.325917    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9n29" event={"ID":"7aefd175-49cf-4963-8ebb-36e238849ae1","Type":"ContainerStarted","Data":"b087618d31ae5121fce880c25212f0ce3b72703422951bf81fd023fb9035f2a9"}
Jul 20 02:49:48.357561 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.357735 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357578    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.357735 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357608    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.357735 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357630    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.357735 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357692    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.357934 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357782    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.357934 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357811    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-web-config\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.357934 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357838    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.357934 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357863    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-out\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.357934 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357887    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.358169 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.357979    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.358169 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.358031    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.358169 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.358056    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6prd7\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-kube-api-access-6prd7\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458084 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458036    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:48.458509 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458485    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458609 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-web-config\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458609 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458609 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458581    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-out\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458791 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458610    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458791 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458791 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458737    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458791 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6prd7\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-kube-api-access-6prd7\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458973 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458827    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458973 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458861    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458973 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.458973 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:48.458911    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-trusted-ca-bundle podName:d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c nodeName:}" failed. No retries permitted until 2026-07-20 02:49:48.95888783 +0000 UTC m=+297.185656523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c") : configmap references non-existent config key: ca-bundle.crt
Jul 20 02:49:48.458973 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458954    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.459208 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.458990    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.461328 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.461273    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.461454 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.461375    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.464411 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.464388    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-out\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.465664 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.465609    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.466247 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.466195    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.466894 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.466678    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.466894 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.466858    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.467537 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.467488    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.468409 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.468386    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.469572 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.469533    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.470095 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.470074    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-web-config\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.476500 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.476477    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6prd7\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-kube-api-access-6prd7\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.956340 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.956305    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:48.962989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.962958    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:48.963782 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:48.963763    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:49.051649 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:49.051613    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:49.216601 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:49.216529    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:49:49.331214 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:49.331176    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9n29" event={"ID":"7aefd175-49cf-4963-8ebb-36e238849ae1","Type":"ContainerStarted","Data":"03b2b2a325aa3fdb494fb36d89b1aa65086e2ee959d1f1a83711b9f76d46d8c2"}
Jul 20 02:49:49.940540 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:49.940507    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:50.040945 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:50.040911    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:50.177516 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:50.177469    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:50.252353 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:50.252285    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:50.672564 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:50.672515    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:51.274944 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:49:51.274903    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-284dq" podUID="9788e27f-288e-4bf0-99ce-aa3440d843a5"
Jul 20 02:49:51.485076 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:51.485038    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:51.942338 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:51.942304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:51.954220 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:51.954191    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"]
Jul 20 02:49:52.037613 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.037578    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:52.067664 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.067616    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"]
Jul 20 02:49:52.067813 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.067729    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:49:52.069995 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.069972    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-25kgx\""
Jul 20 02:49:52.070532 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.070511    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 02:49:52.192093 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.192055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2023c6b-ccd9-4e21-bb78-9c7d996e984a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-l9d89\" (UID: \"e2023c6b-ccd9-4e21-bb78-9c7d996e984a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:49:52.192285 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.192243    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkwlp\" (UniqueName: \"kubernetes.io/projected/e2023c6b-ccd9-4e21-bb78-9c7d996e984a-kube-api-access-hkwlp\") pod \"monitoring-plugin-7b7b7bc8bf-l9d89\" (UID: \"e2023c6b-ccd9-4e21-bb78-9c7d996e984a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:49:52.293663 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.293502    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2023c6b-ccd9-4e21-bb78-9c7d996e984a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-l9d89\" (UID: \"e2023c6b-ccd9-4e21-bb78-9c7d996e984a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:49:52.293663 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.293624    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkwlp\" (UniqueName: \"kubernetes.io/projected/e2023c6b-ccd9-4e21-bb78-9c7d996e984a-kube-api-access-hkwlp\") pod \"monitoring-plugin-7b7b7bc8bf-l9d89\" (UID: \"e2023c6b-ccd9-4e21-bb78-9c7d996e984a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:49:52.439272 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.295526    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 02:49:52.439272 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.300625    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkwlp\" (UniqueName: \"kubernetes.io/projected/e2023c6b-ccd9-4e21-bb78-9c7d996e984a-kube-api-access-hkwlp\") pod \"monitoring-plugin-7b7b7bc8bf-l9d89\" (UID: \"e2023c6b-ccd9-4e21-bb78-9c7d996e984a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:49:52.439272 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.306372    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2023c6b-ccd9-4e21-bb78-9c7d996e984a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-l9d89\" (UID: \"e2023c6b-ccd9-4e21-bb78-9c7d996e984a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:49:52.439272 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.380287    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-25kgx\""
Jul 20 02:49:52.439272 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:52.388696    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:49:53.412502 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:53.412461    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:53.559578 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:53.559537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:53.660058 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:53.660015    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:55.312720 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.312685    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bnqc8"
Jul 20 02:49:55.769881 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.769802    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fbddb8b49-2ztdt"]
Jul 20 02:49:55.799460 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.799430    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbddb8b49-2ztdt"]
Jul 20 02:49:55.799673 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.799541    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:55.801946 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.801922    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 02:49:55.802089 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.801921    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5q4k\""
Jul 20 02:49:55.802089 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.801992    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 02:49:55.802089 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.802039    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 02:49:55.802089 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.802041    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 02:49:55.802089 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.801995    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 02:49:55.811935 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.809899    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 02:49:55.927432 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.927402    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-serving-cert\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:55.927634 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.927466    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-oauth-config\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:55.927634 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.927521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-trusted-ca-bundle\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:55.927634 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.927607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhmn\" (UniqueName: \"kubernetes.io/projected/ae8979b5-60b2-4276-9bb3-d3a87947e96f-kube-api-access-5rhmn\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:55.927820 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.927656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-oauth-serving-cert\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:55.927820 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.927685    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-service-ca\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:55.927820 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:55.927749    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-config\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.028906 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.028820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhmn\" (UniqueName: \"kubernetes.io/projected/ae8979b5-60b2-4276-9bb3-d3a87947e96f-kube-api-access-5rhmn\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.028906 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.028866    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-oauth-serving-cert\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.028906 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.028887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-service-ca\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.029184 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.028911    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-config\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.029184 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.028928    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-serving-cert\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.029184 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.028971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-oauth-config\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.029184 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.029000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-trusted-ca-bundle\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.029668 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.029618    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-oauth-serving-cert\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.029668 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.029662    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-config\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.029953 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.029911    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-service-ca\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.030065 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.029975    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-trusted-ca-bundle\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.031652 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.031620    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-serving-cert\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.031767 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.031748    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-oauth-config\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.036005 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.035986    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhmn\" (UniqueName: \"kubernetes.io/projected/ae8979b5-60b2-4276-9bb3-d3a87947e96f-kube-api-access-5rhmn\") pod \"console-fbddb8b49-2ztdt\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") " pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.112734 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.112701    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:49:56.135522 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.135500    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:56.215491 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.215420    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:49:56.216240 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.216218    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:49:56.222502 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.222483    2584 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 02:49:56.328356 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.328316    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 02:49:56.338097 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.338079    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"]
Jul 20 02:49:56.355837 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.355813    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbddb8b49-2ztdt"]
Jul 20 02:49:56.361490 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.361467    2584 generic.go:356] "Generic (PLEG): container finished" podID="7aefd175-49cf-4963-8ebb-36e238849ae1" containerID="03b2b2a325aa3fdb494fb36d89b1aa65086e2ee959d1f1a83711b9f76d46d8c2" exitCode=0
Jul 20 02:49:56.361589 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.361542    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9n29" event={"ID":"7aefd175-49cf-4963-8ebb-36e238849ae1","Type":"ContainerDied","Data":"03b2b2a325aa3fdb494fb36d89b1aa65086e2ee959d1f1a83711b9f76d46d8c2"}
Jul 20 02:49:56.493776 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:56.493749    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c42cab_b0fa_4d2f_9c83_e4e2c73ad42c.slice/crio-bb8296722970917fc78f3f89ae3906dcd49f89a177b4927f1c1d81b7b56ccc56 WatchSource:0}: Error finding container bb8296722970917fc78f3f89ae3906dcd49f89a177b4927f1c1d81b7b56ccc56: Status 404 returned error can't find the container with id bb8296722970917fc78f3f89ae3906dcd49f89a177b4927f1c1d81b7b56ccc56
Jul 20 02:49:56.494341 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:56.494321    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2023c6b_ccd9_4e21_bb78_9c7d996e984a.slice/crio-2066243c396b77a6bc84c6aa4209cf49a72c59911c83ec3e1c83725fe5ca408e WatchSource:0}: Error finding container 2066243c396b77a6bc84c6aa4209cf49a72c59911c83ec3e1c83725fe5ca408e: Status 404 returned error can't find the container with id 2066243c396b77a6bc84c6aa4209cf49a72c59911c83ec3e1c83725fe5ca408e
Jul 20 02:49:56.495579 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:49:56.495554    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae8979b5_60b2_4276_9bb3_d3a87947e96f.slice/crio-9bf40556eabd76124543a0a8b3550787aff4104f1e8ba4ef4c2d3f937c8f9818 WatchSource:0}: Error finding container 9bf40556eabd76124543a0a8b3550787aff4104f1e8ba4ef4c2d3f937c8f9818: Status 404 returned error can't find the container with id 9bf40556eabd76124543a0a8b3550787aff4104f1e8ba4ef4c2d3f937c8f9818
Jul 20 02:49:56.515147 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:56.515129    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 02:49:57.180569 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.180456    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:57.369587 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.369535    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbddb8b49-2ztdt" event={"ID":"ae8979b5-60b2-4276-9bb3-d3a87947e96f","Type":"ContainerStarted","Data":"9bf40556eabd76124543a0a8b3550787aff4104f1e8ba4ef4c2d3f937c8f9818"}
Jul 20 02:49:57.374850 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.374820    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerStarted","Data":"bb8296722970917fc78f3f89ae3906dcd49f89a177b4927f1c1d81b7b56ccc56"}
Jul 20 02:49:57.379047 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.378905    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-87jzx" event={"ID":"0d9a255a-7ec0-44dc-a7e0-c34b00328c8a","Type":"ContainerStarted","Data":"6f691acc8107e196634c3edb08efbda20e1070fd162904e9e6a80ad682269cf7"}
Jul 20 02:49:57.379721 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.379696    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-87jzx"
Jul 20 02:49:57.382622 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.382599    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89" event={"ID":"e2023c6b-ccd9-4e21-bb78-9c7d996e984a","Type":"ContainerStarted","Data":"2066243c396b77a6bc84c6aa4209cf49a72c59911c83ec3e1c83725fe5ca408e"}
Jul 20 02:49:57.388171 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.386779    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9n29" event={"ID":"7aefd175-49cf-4963-8ebb-36e238849ae1","Type":"ContainerStarted","Data":"b1b53cf8702a53bd774a27f687888106f52860c6faa373ec70ecb00a2508e620"}
Jul 20 02:49:57.388171 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.386824    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9n29" event={"ID":"7aefd175-49cf-4963-8ebb-36e238849ae1","Type":"ContainerStarted","Data":"2d5d1d2281ce08bb2afd2ba904833a004fd60b24ab7c6e66da4dbd667152f5c0"}
Jul 20 02:49:57.389809 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.389763    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-87jzx"
Jul 20 02:49:57.399314 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.398122    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-87jzx" podStartSLOduration=3.6105317169999998 podStartE2EDuration="21.3981054s" totalImagesPullingTime="17.787573683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:57.397398815 +0000 UTC m=+305.624167513" watchObservedRunningTime="2026-07-20 02:49:57.3981054 +0000 UTC m=+305.624874100"
Jul 20 02:49:57.417274 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:57.417047    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t9n29" podStartSLOduration=8.836612031 podStartE2EDuration="10.417030002s" totalImagesPullingTime="1.478205815s" totalInitContainerRuntime="102.212156ms" isStatefulPod=true podCreationTimestamp="2026-07-20 02:49:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:49:57.414943497 +0000 UTC m=+305.641712198" watchObservedRunningTime="2026-07-20 02:49:57.417030002 +0000 UTC m=+305.643798704"
Jul 20 02:49:58.129577 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:58.129498    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:58.211674 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:58.210835    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76c5564449-659jx"]
Jul 20 02:49:58.217277 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:58.217240    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:58.219330 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:58.219302    2584 patch_prober.go:28] interesting pod/image-registry-76c5564449-659jx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 02:49:58.219431 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:58.219352    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76c5564449-659jx" podUID="daf110bc-f49b-4a57-bca9-ff688ce7d3ca" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 02:49:58.306118 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:58.306082    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:58.409295 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:58.409221    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:49:59.400102 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:59.399972    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerID="fbf1806fb52c60f455cb12511d1bde1404e96ed2de456ebcc52ea7e420cd647b" exitCode=0
Jul 20 02:49:59.400331 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:49:59.400091    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerDied","Data":"fbf1806fb52c60f455cb12511d1bde1404e96ed2de456ebcc52ea7e420cd647b"}
Jul 20 02:50:00.405875 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:00.405838    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89" event={"ID":"e2023c6b-ccd9-4e21-bb78-9c7d996e984a","Type":"ContainerStarted","Data":"c720aa37ae845f19ffa956dfed6114288da0a46a817a9fbaa35bb73347c12cf2"}
Jul 20 02:50:00.406322 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:00.406032    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:50:00.411556 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:00.411535    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89"
Jul 20 02:50:00.420895 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:00.420546    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-l9d89" podStartSLOduration=5.701445796 podStartE2EDuration="9.420532544s" totalImagesPullingTime="3.719086748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:50:00.420119844 +0000 UTC m=+308.646888548" watchObservedRunningTime="2026-07-20 02:50:00.420532544 +0000 UTC m=+308.647301244"
Jul 20 02:50:00.746208 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:00.746093    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:01.415259 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:01.414156    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbddb8b49-2ztdt" event={"ID":"ae8979b5-60b2-4276-9bb3-d3a87947e96f","Type":"ContainerStarted","Data":"201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1"}
Jul 20 02:50:01.430898 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:01.430839    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fbddb8b49-2ztdt" podStartSLOduration=2.325083172 podStartE2EDuration="6.430817342s" totalImagesPullingTime="4.10573417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:50:01.429945346 +0000 UTC m=+309.656714072" watchObservedRunningTime="2026-07-20 02:50:01.430817342 +0000 UTC m=+309.657586047"
Jul 20 02:50:02.421088 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:02.421044    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerStarted","Data":"2bbbf00bbbaa1c8e12d0cb3ec2bd2be3c422533f30401fea4effc2c24f4e8a21"}
Jul 20 02:50:02.680991 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:02.680957    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:02.795982 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:02.795949    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:03.430156 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:03.430123    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerStarted","Data":"b20e7f1b01ac722fa78089f7ec7abea58ce20af0f514b3970442670d75690e98"}
Jul 20 02:50:03.430591 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:03.430230    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerStarted","Data":"0e8393ffa76ed7a65d45c8f61e981fadd2a4bb4068fc716a83ec1c4dc4aea43f"}
Jul 20 02:50:03.430591 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:03.430276    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerStarted","Data":"c7434b76200e97631c6615c2b25e1db139429f568b13d12cba723cc08916b406"}
Jul 20 02:50:03.430591 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:03.430301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerStarted","Data":"f5c4c1517141f263e076f2f38b1bbe3d48212c3a6439814bfbd56da3f930fc40"}
Jul 20 02:50:04.432604 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:04.432574    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:04.438998 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:04.438967    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerStarted","Data":"6ea1ef2549fa2f4df21b30c802c1be6ab68249360fb7a11fd02912f6065811e1"}
Jul 20 02:50:04.468079 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:04.468021    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.886245329 podStartE2EDuration="16.468000872s" totalImagesPullingTime="5.557049892s" totalInitContainerRuntime="24.705651ms" isStatefulPod=false podCreationTimestamp="2026-07-20 02:49:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:50:04.466082799 +0000 UTC m=+312.692851498" watchObservedRunningTime="2026-07-20 02:50:04.468000872 +0000 UTC m=+312.694769574"
Jul 20 02:50:04.533580 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:04.533550    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:06.113139 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:06.113099    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:50:06.113528 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:06.113162    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:50:06.117935 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:06.117912    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:50:06.274001 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:06.273971    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:50:06.451613 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:06.451545    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:50:06.589239 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:06.589209    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:06.690300 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:06.690260    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:06.739792 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:06.739710    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:08.216198 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:08.216171    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:50:12.744423 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:12.744387    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:12.793986 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:12.793928    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:13.436972 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:13.436938    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:13.490468 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:13.490438    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:19.496965 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:19.496931    2584 generic.go:356] "Generic (PLEG): container finished" podID="b7d6f323-62eb-4e28-add3-d8fb80de0bcc" containerID="4c153e9c9d08af6b806c059cb10b622af62a96666f210652388bb23b931da5a1" exitCode=0
Jul 20 02:50:19.497365 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:19.497005    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jspkh" event={"ID":"b7d6f323-62eb-4e28-add3-d8fb80de0bcc","Type":"ContainerDied","Data":"4c153e9c9d08af6b806c059cb10b622af62a96666f210652388bb23b931da5a1"}
Jul 20 02:50:19.497365 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:19.497357    2584 scope.go:117] "RemoveContainer" containerID="4c153e9c9d08af6b806c059cb10b622af62a96666f210652388bb23b931da5a1"
Jul 20 02:50:20.502937 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:20.502899    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jspkh" event={"ID":"b7d6f323-62eb-4e28-add3-d8fb80de0bcc","Type":"ContainerStarted","Data":"ab7cca5be5cce0de0339708b2975adbcfceee210600af2e74a120d7ab02a978e"}
Jul 20 02:50:21.741973 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:21.741934    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:21.806982 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:21.806950    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:22.450488 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:22.450455    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:22.498896 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:22.498868    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:23.242091 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.242046    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76c5564449-659jx" podUID="daf110bc-f49b-4a57-bca9-ff688ce7d3ca" containerName="registry" containerID="cri-o://1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781" gracePeriod=30
Jul 20 02:50:23.474303 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.474277    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:50:23.518288 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.518215    2584 generic.go:356] "Generic (PLEG): container finished" podID="daf110bc-f49b-4a57-bca9-ff688ce7d3ca" containerID="1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781" exitCode=0
Jul 20 02:50:23.518288 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.518253    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c5564449-659jx"
Jul 20 02:50:23.518469 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.518295    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c5564449-659jx" event={"ID":"daf110bc-f49b-4a57-bca9-ff688ce7d3ca","Type":"ContainerDied","Data":"1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781"}
Jul 20 02:50:23.518469 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.518368    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c5564449-659jx" event={"ID":"daf110bc-f49b-4a57-bca9-ff688ce7d3ca","Type":"ContainerDied","Data":"c579c076efdb7c8ac9beafef4651f8f2212e9ebd3ad0d8465468b10039e949f3"}
Jul 20 02:50:23.518469 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.518388    2584 scope.go:117] "RemoveContainer" containerID="1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781"
Jul 20 02:50:23.526371 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.526355    2584 scope.go:117] "RemoveContainer" containerID="1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781"
Jul 20 02:50:23.526630 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:50:23.526610    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781\": container with ID starting with 1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781 not found: ID does not exist" containerID="1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781"
Jul 20 02:50:23.526721 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.526658    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781"} err="failed to get container status \"1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781\": rpc error: code = NotFound desc = could not find container \"1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781\": container with ID starting with 1874d7dc833d6b9a9d4b5271818df1b3b7340bad3d41ed9cac7191ac98217781 not found: ID does not exist"
Jul 20 02:50:23.591230 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591198    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-certificates\") pod \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") "
Jul 20 02:50:23.591230 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591233    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-ca-trust-extracted\") pod \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") "
Jul 20 02:50:23.591461 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591258    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-trusted-ca\") pod \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") "
Jul 20 02:50:23.591461 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591278    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-bound-sa-token\") pod \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") "
Jul 20 02:50:23.591461 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591343    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") pod \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") "
Jul 20 02:50:23.591461 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591383    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j55gc\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-kube-api-access-j55gc\") pod \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") "
Jul 20 02:50:23.591688 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591519    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-installation-pull-secrets\") pod \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") "
Jul 20 02:50:23.591688 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591572    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-image-registry-private-configuration\") pod \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\" (UID: \"daf110bc-f49b-4a57-bca9-ff688ce7d3ca\") "
Jul 20 02:50:23.591688 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591677    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "daf110bc-f49b-4a57-bca9-ff688ce7d3ca" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:50:23.591852 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591718    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "daf110bc-f49b-4a57-bca9-ff688ce7d3ca" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:50:23.591971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591923    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-certificates\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:50:23.591971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.591948    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-trusted-ca\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:50:23.593966 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.593938    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "daf110bc-f49b-4a57-bca9-ff688ce7d3ca" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 02:50:23.594071 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.594044    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "daf110bc-f49b-4a57-bca9-ff688ce7d3ca" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 02:50:23.594148 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.594129    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "daf110bc-f49b-4a57-bca9-ff688ce7d3ca" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:50:23.594200 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.594130    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-kube-api-access-j55gc" (OuterVolumeSpecName: "kube-api-access-j55gc") pod "daf110bc-f49b-4a57-bca9-ff688ce7d3ca" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca"). InnerVolumeSpecName "kube-api-access-j55gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 02:50:23.594266 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.594239    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "daf110bc-f49b-4a57-bca9-ff688ce7d3ca" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:50:23.600995 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.600972    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "daf110bc-f49b-4a57-bca9-ff688ce7d3ca" (UID: "daf110bc-f49b-4a57-bca9-ff688ce7d3ca"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 02:50:23.692780 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.692749    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-bound-sa-token\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:50:23.692780 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.692773    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-registry-tls\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:50:23.692780 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.692782    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j55gc\" (UniqueName: \"kubernetes.io/projected/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-kube-api-access-j55gc\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:50:23.693003 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.692791    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-installation-pull-secrets\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:50:23.693003 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.692800    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-image-registry-private-configuration\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:50:23.693003 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.692809    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/daf110bc-f49b-4a57-bca9-ff688ce7d3ca-ca-trust-extracted\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:50:23.838260 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.838231    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76c5564449-659jx"]
Jul 20 02:50:23.841773 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:23.841749    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76c5564449-659jx"]
Jul 20 02:50:24.277861 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:24.277786    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daf110bc-f49b-4a57-bca9-ff688ce7d3ca" path="/var/lib/kubelet/pods/daf110bc-f49b-4a57-bca9-ff688ce7d3ca/volumes"
Jul 20 02:50:25.108503 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:25.108454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:28.767188 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:28.767148    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:28.868498 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:28.868462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:43.766135 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:43.766055    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:43.864514 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:43.864472    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:50:44.602243 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:44.602212    2584 generic.go:356] "Generic (PLEG): container finished" podID="9f5a15af-3d20-4917-b235-23d3d270cedb" containerID="c811580a5ca89ba67d9ca9599eb44b98137f4b34b45fa24212763f355b96d2d8" exitCode=0
Jul 20 02:50:44.602393 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:44.602286    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq" event={"ID":"9f5a15af-3d20-4917-b235-23d3d270cedb","Type":"ContainerDied","Data":"c811580a5ca89ba67d9ca9599eb44b98137f4b34b45fa24212763f355b96d2d8"}
Jul 20 02:50:44.602604 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:44.602592    2584 scope.go:117] "RemoveContainer" containerID="c811580a5ca89ba67d9ca9599eb44b98137f4b34b45fa24212763f355b96d2d8"
Jul 20 02:50:45.607354 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:50:45.607320    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-nfdqq" event={"ID":"9f5a15af-3d20-4917-b235-23d3d270cedb","Type":"ContainerStarted","Data":"9a4bd9a6c2e4f12d2aaeac6bc72a2911e263544c71b1dd973c54dd4ae996e3db"}
Jul 20 02:51:06.240888 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:06.240847    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:51:06.243092 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:06.243067    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9788e27f-288e-4bf0-99ce-aa3440d843a5-metrics-certs\") pod \"network-metrics-daemon-284dq\" (UID: \"9788e27f-288e-4bf0-99ce-aa3440d843a5\") " pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:51:06.276233 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:06.276205    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8vd4r\""
Jul 20 02:51:06.285107 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:06.285083    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-284dq"
Jul 20 02:51:06.416249 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:06.416212    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-284dq"]
Jul 20 02:51:06.419728 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:51:06.419594    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9788e27f_288e_4bf0_99ce_aa3440d843a5.slice/crio-8f51c6e0b033c1b508b26d8193994f7e6e1314833da754792834920416188aaa WatchSource:0}: Error finding container 8f51c6e0b033c1b508b26d8193994f7e6e1314833da754792834920416188aaa: Status 404 returned error can't find the container with id 8f51c6e0b033c1b508b26d8193994f7e6e1314833da754792834920416188aaa
Jul 20 02:51:06.426494 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:06.426469    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:06.686315 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:06.686280    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-284dq" event={"ID":"9788e27f-288e-4bf0-99ce-aa3440d843a5","Type":"ContainerStarted","Data":"8f51c6e0b033c1b508b26d8193994f7e6e1314833da754792834920416188aaa"}
Jul 20 02:51:07.064726 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.064663    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:07.493041 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.493019    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 02:51:07.493435 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.493410    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="alertmanager" containerID="cri-o://2bbbf00bbbaa1c8e12d0cb3ec2bd2be3c422533f30401fea4effc2c24f4e8a21" gracePeriod=120
Jul 20 02:51:07.493485 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.493444    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy-metric" containerID="cri-o://b20e7f1b01ac722fa78089f7ec7abea58ce20af0f514b3970442670d75690e98" gracePeriod=120
Jul 20 02:51:07.493539 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.493475    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy-web" containerID="cri-o://c7434b76200e97631c6615c2b25e1db139429f568b13d12cba723cc08916b406" gracePeriod=120
Jul 20 02:51:07.493539 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.493523    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="config-reloader" containerID="cri-o://f5c4c1517141f263e076f2f38b1bbe3d48212c3a6439814bfbd56da3f930fc40" gracePeriod=120
Jul 20 02:51:07.493654 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.493475    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="prom-label-proxy" containerID="cri-o://6ea1ef2549fa2f4df21b30c802c1be6ab68249360fb7a11fd02912f6065811e1" gracePeriod=120
Jul 20 02:51:07.493654 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.493525    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy" containerID="cri-o://0e8393ffa76ed7a65d45c8f61e981fadd2a4bb4068fc716a83ec1c4dc4aea43f" gracePeriod=120
Jul 20 02:51:07.693094 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.693059    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-284dq" event={"ID":"9788e27f-288e-4bf0-99ce-aa3440d843a5","Type":"ContainerStarted","Data":"1d97ba6859f62c1163486a7e7320f32ecc1d4139f7f7379f326fd3de232d9a44"}
Jul 20 02:51:07.696560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.696537    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerID="6ea1ef2549fa2f4df21b30c802c1be6ab68249360fb7a11fd02912f6065811e1" exitCode=0
Jul 20 02:51:07.696560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.696558    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerID="0e8393ffa76ed7a65d45c8f61e981fadd2a4bb4068fc716a83ec1c4dc4aea43f" exitCode=0
Jul 20 02:51:07.696731 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.696567    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerID="f5c4c1517141f263e076f2f38b1bbe3d48212c3a6439814bfbd56da3f930fc40" exitCode=0
Jul 20 02:51:07.696731 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.696574    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerID="2bbbf00bbbaa1c8e12d0cb3ec2bd2be3c422533f30401fea4effc2c24f4e8a21" exitCode=0
Jul 20 02:51:07.696731 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.696605    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerDied","Data":"6ea1ef2549fa2f4df21b30c802c1be6ab68249360fb7a11fd02912f6065811e1"}
Jul 20 02:51:07.696731 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.696679    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerDied","Data":"0e8393ffa76ed7a65d45c8f61e981fadd2a4bb4068fc716a83ec1c4dc4aea43f"}
Jul 20 02:51:07.696731 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.696707    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerDied","Data":"f5c4c1517141f263e076f2f38b1bbe3d48212c3a6439814bfbd56da3f930fc40"}
Jul 20 02:51:07.696731 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:07.696730    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerDied","Data":"2bbbf00bbbaa1c8e12d0cb3ec2bd2be3c422533f30401fea4effc2c24f4e8a21"}
Jul 20 02:51:08.703200 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.703158    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-284dq" event={"ID":"9788e27f-288e-4bf0-99ce-aa3440d843a5","Type":"ContainerStarted","Data":"33fb05754146da5b646e912bb6ab7c3a1c494a58e6b75f16d57be954fd00f82c"}
Jul 20 02:51:08.706697 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.706673    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerID="b20e7f1b01ac722fa78089f7ec7abea58ce20af0f514b3970442670d75690e98" exitCode=0
Jul 20 02:51:08.706697 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.706695    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerID="c7434b76200e97631c6615c2b25e1db139429f568b13d12cba723cc08916b406" exitCode=0
Jul 20 02:51:08.706849 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.706744    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerDied","Data":"b20e7f1b01ac722fa78089f7ec7abea58ce20af0f514b3970442670d75690e98"}
Jul 20 02:51:08.706849 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.706818    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerDied","Data":"c7434b76200e97631c6615c2b25e1db139429f568b13d12cba723cc08916b406"}
Jul 20 02:51:08.719260 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.719215    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-284dq" podStartSLOduration=374.654571678 podStartE2EDuration="6m15.719200356s" totalImagesPullingTime="1.064628678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:51:08.71818287 +0000 UTC m=+376.944951583" watchObservedRunningTime="2026-07-20 02:51:08.719200356 +0000 UTC m=+376.945969054"
Jul 20 02:51:08.740002 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.739981    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:08.764419 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.764394    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-web-config\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.764581 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.764428    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.764581 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.764454    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-metrics-client-ca\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.764581 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.764478    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.764581 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.764515    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-volume\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.764581 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.764539    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-trusted-ca-bundle\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.764581 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.764578    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-main-db\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.765084 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.764693    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6prd7\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-kube-api-access-6prd7\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.765084 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.764954    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:51:08.765206 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765156    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-web\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.765206 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765189    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-main-tls\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.765302 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765207    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:51:08.765302 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765266    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-tls-assets\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.765302 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765293    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-out\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.765437 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765312    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 02:51:08.765437 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765323    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-cluster-tls-config\") pod \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\" (UID: \"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c\") "
Jul 20 02:51:08.765607 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765572    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-metrics-client-ca\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.765607 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765597    2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.765742 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.765611    2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-alertmanager-main-db\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.768471 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.768449    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:51:08.768620 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.768581    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-kube-api-access-6prd7" (OuterVolumeSpecName: "kube-api-access-6prd7") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "kube-api-access-6prd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 02:51:08.769059 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.769024    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-volume" (OuterVolumeSpecName: "config-volume") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:51:08.770315 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.770274    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-out" (OuterVolumeSpecName: "config-out") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 02:51:08.770901 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.770864    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 02:51:08.771048 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.770974    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:51:08.771160 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.771136    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:51:08.772360 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.772322    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:51:08.776590 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.776286    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:51:08.782803 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.782779    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-web-config" (OuterVolumeSpecName: "web-config") pod "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" (UID: "d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:51:08.866383 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866256    2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-volume\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.866383 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866303    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6prd7\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-kube-api-access-6prd7\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.866383 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866318    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.866383 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866331    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-main-tls\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.866383 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866343    2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-tls-assets\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.866383 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866353    2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-config-out\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.866383 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866363    2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-cluster-tls-config\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.866383 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866376    2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-web-config\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.866383 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866388    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.866796 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.866401    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:08.888592 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.888559    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:08.989083 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:08.989046    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:09.713593 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.713566    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.713593 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.713578    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c","Type":"ContainerDied","Data":"bb8296722970917fc78f3f89ae3906dcd49f89a177b4927f1c1d81b7b56ccc56"}
Jul 20 02:51:09.714097 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.713695    2584 scope.go:117] "RemoveContainer" containerID="6ea1ef2549fa2f4df21b30c802c1be6ab68249360fb7a11fd02912f6065811e1"
Jul 20 02:51:09.721740 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.721666    2584 scope.go:117] "RemoveContainer" containerID="b20e7f1b01ac722fa78089f7ec7abea58ce20af0f514b3970442670d75690e98"
Jul 20 02:51:09.730962 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.730944    2584 scope.go:117] "RemoveContainer" containerID="0e8393ffa76ed7a65d45c8f61e981fadd2a4bb4068fc716a83ec1c4dc4aea43f"
Jul 20 02:51:09.737415 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.737394    2584 scope.go:117] "RemoveContainer" containerID="c7434b76200e97631c6615c2b25e1db139429f568b13d12cba723cc08916b406"
Jul 20 02:51:09.739435 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.739412    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 02:51:09.748174 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.745509    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 02:51:09.748174 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.745591    2584 scope.go:117] "RemoveContainer" containerID="f5c4c1517141f263e076f2f38b1bbe3d48212c3a6439814bfbd56da3f930fc40"
Jul 20 02:51:09.755084 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.755060    2584 scope.go:117] "RemoveContainer" containerID="2bbbf00bbbaa1c8e12d0cb3ec2bd2be3c422533f30401fea4effc2c24f4e8a21"
Jul 20 02:51:09.761915 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.761898    2584 scope.go:117] "RemoveContainer" containerID="fbf1806fb52c60f455cb12511d1bde1404e96ed2de456ebcc52ea7e420cd647b"
Jul 20 02:51:09.769462 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769441    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 02:51:09.769788 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769773    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="config-reloader"
Jul 20 02:51:09.769866 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769791    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="config-reloader"
Jul 20 02:51:09.769866 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769803    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy-metric"
Jul 20 02:51:09.769866 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769810    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy-metric"
Jul 20 02:51:09.769866 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769822    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy-web"
Jul 20 02:51:09.769866 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769830    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy-web"
Jul 20 02:51:09.769866 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769844    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="prom-label-proxy"
Jul 20 02:51:09.769866 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769853    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="prom-label-proxy"
Jul 20 02:51:09.769866 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769866    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="init-config-reloader"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769874    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="init-config-reloader"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769885    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="alertmanager"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769893    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="alertmanager"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769906    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769914    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769928    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daf110bc-f49b-4a57-bca9-ff688ce7d3ca" containerName="registry"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.769936    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="daf110bc-f49b-4a57-bca9-ff688ce7d3ca" containerName="registry"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.770004    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy-metric"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.770015    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.770025    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="kube-rbac-proxy-web"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.770036    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="config-reloader"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.770043    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="daf110bc-f49b-4a57-bca9-ff688ce7d3ca" containerName="registry"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.770053    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="alertmanager"
Jul 20 02:51:09.770235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.770062    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" containerName="prom-label-proxy"
Jul 20 02:51:09.773733 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.773715    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.775701 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.775681    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 02:51:09.775796 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.775741    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 02:51:09.775796 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.775758    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 02:51:09.775903 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.775798    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sjgnw\""
Jul 20 02:51:09.775903 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.775744    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 02:51:09.776015 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.776002    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 02:51:09.776191 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.776172    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 02:51:09.776378 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.776361    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 02:51:09.776452 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.776384    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 02:51:09.782096 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.782075    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 02:51:09.785756 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.785737    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 02:51:09.874896 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.874821    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.874896 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.874852    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.874896 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.874874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b745520c-1dbd-4350-9be4-994400681c33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875095 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.874953    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b745520c-1dbd-4350-9be4-994400681c33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875095 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.875032    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-web-config\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875095 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.875060    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875095 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.875078    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875224 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.875098    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d529v\" (UniqueName: \"kubernetes.io/projected/b745520c-1dbd-4350-9be4-994400681c33-kube-api-access-d529v\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875224 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.875121    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875224 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.875160    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b745520c-1dbd-4350-9be4-994400681c33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875224 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.875179    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b745520c-1dbd-4350-9be4-994400681c33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875224 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.875197    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b745520c-1dbd-4350-9be4-994400681c33-config-out\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.875367 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.875237    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-config-volume\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975743 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b745520c-1dbd-4350-9be4-994400681c33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975743 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975742    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b745520c-1dbd-4350-9be4-994400681c33-config-out\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975763    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-config-volume\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975799    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975830    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b745520c-1dbd-4350-9be4-994400681c33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975854    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b745520c-1dbd-4350-9be4-994400681c33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-web-config\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975923    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.975971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975952    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.976357 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.975977    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d529v\" (UniqueName: \"kubernetes.io/projected/b745520c-1dbd-4350-9be4-994400681c33-kube-api-access-d529v\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.976357 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.976001    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.976357 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.976033    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b745520c-1dbd-4350-9be4-994400681c33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.976357 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.976244    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b745520c-1dbd-4350-9be4-994400681c33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.977362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.977332    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b745520c-1dbd-4350-9be4-994400681c33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.978758 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.978722    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b745520c-1dbd-4350-9be4-994400681c33-config-out\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.978889 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.978867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-config-volume\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.978962 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.978880    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.979014 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.978967    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.979106 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.979080    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.979298 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.979273    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b745520c-1dbd-4350-9be4-994400681c33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.979385 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.979324    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-web-config\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.979441 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.979381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b745520c-1dbd-4350-9be4-994400681c33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.980158 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.980137    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.980761 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.980742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b745520c-1dbd-4350-9be4-994400681c33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:09.985388 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:09.985369    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d529v\" (UniqueName: \"kubernetes.io/projected/b745520c-1dbd-4350-9be4-994400681c33-kube-api-access-d529v\") pod \"alertmanager-main-0\" (UID: \"b745520c-1dbd-4350-9be4-994400681c33\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:10.084785 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:10.084749    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 02:51:10.215359 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:10.215261    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 02:51:10.217221 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:51:10.217197    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb745520c_1dbd_4350_9be4_994400681c33.slice/crio-7cdacaf2288c986d2d50d45ad97eb1d15f92028005bf729426761713fac61907 WatchSource:0}: Error finding container 7cdacaf2288c986d2d50d45ad97eb1d15f92028005bf729426761713fac61907: Status 404 returned error can't find the container with id 7cdacaf2288c986d2d50d45ad97eb1d15f92028005bf729426761713fac61907
Jul 20 02:51:10.278673 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:10.278622    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c" path="/var/lib/kubelet/pods/d3c42cab-b0fa-4d2f-9c83-e4e2c73ad42c/volumes"
Jul 20 02:51:10.719921 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:10.719889    2584 generic.go:356] "Generic (PLEG): container finished" podID="b745520c-1dbd-4350-9be4-994400681c33" containerID="92dbc2bb23753366bc7d16d2e6cad302bd02b94ce1fbda900870840fbf632929" exitCode=0
Jul 20 02:51:10.720343 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:10.719979    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b745520c-1dbd-4350-9be4-994400681c33","Type":"ContainerDied","Data":"92dbc2bb23753366bc7d16d2e6cad302bd02b94ce1fbda900870840fbf632929"}
Jul 20 02:51:10.720343 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:10.720048    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b745520c-1dbd-4350-9be4-994400681c33","Type":"ContainerStarted","Data":"7cdacaf2288c986d2d50d45ad97eb1d15f92028005bf729426761713fac61907"}
Jul 20 02:51:11.512664 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.511936    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"]
Jul 20 02:51:11.516264 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.516231    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.518243 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.518221    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jpxjc\""
Jul 20 02:51:11.518404 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.518246    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 02:51:11.518404 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.518278    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 02:51:11.518404 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.518228    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 02:51:11.518732 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.518601    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 02:51:11.518732 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.518661    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 02:51:11.523271 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.523250    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 02:51:11.527132 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.527112    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"]
Jul 20 02:51:11.587362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.587331    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70dc7872-a087-4a3d-b948-e9199504ec86-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.587362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.587366    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70dc7872-a087-4a3d-b948-e9199504ec86-serving-certs-ca-bundle\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.587568 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.587392    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70dc7872-a087-4a3d-b948-e9199504ec86-metrics-client-ca\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.587568 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.587486    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-telemeter-client-tls\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.587568 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.587537    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.587568 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.587557    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-secret-telemeter-client\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.587709 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.587574    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p62px\" (UniqueName: \"kubernetes.io/projected/70dc7872-a087-4a3d-b948-e9199504ec86-kube-api-access-p62px\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.587709 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.587595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-federate-client-tls\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.688395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.688349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70dc7872-a087-4a3d-b948-e9199504ec86-serving-certs-ca-bundle\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.688586 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.688419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70dc7872-a087-4a3d-b948-e9199504ec86-metrics-client-ca\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.688586 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.688466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-telemeter-client-tls\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.688586 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.688507    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.688586 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.688531    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-secret-telemeter-client\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.688586 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.688554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p62px\" (UniqueName: \"kubernetes.io/projected/70dc7872-a087-4a3d-b948-e9199504ec86-kube-api-access-p62px\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.688586 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.688585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-federate-client-tls\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.688900 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.688625    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70dc7872-a087-4a3d-b948-e9199504ec86-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.689936 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.689854    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70dc7872-a087-4a3d-b948-e9199504ec86-metrics-client-ca\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.689936 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.689874    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70dc7872-a087-4a3d-b948-e9199504ec86-serving-certs-ca-bundle\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.689936 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.689860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70dc7872-a087-4a3d-b948-e9199504ec86-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.691861 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.691836    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-secret-telemeter-client\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.691983 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.691918    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-federate-client-tls\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.692120 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.692104    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-telemeter-client-tls\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.692154 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.692119    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70dc7872-a087-4a3d-b948-e9199504ec86-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.697201 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.697168    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p62px\" (UniqueName: \"kubernetes.io/projected/70dc7872-a087-4a3d-b948-e9199504ec86-kube-api-access-p62px\") pod \"telemeter-client-7c466df9c8-bzrnz\" (UID: \"70dc7872-a087-4a3d-b948-e9199504ec86\") " pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.729251 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.729220    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b745520c-1dbd-4350-9be4-994400681c33","Type":"ContainerStarted","Data":"b7b6f35d48ac14e8a11ddfb2acc1a9080a97714c4ec82b2ae2940458ed3fe846"}
Jul 20 02:51:11.729707 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.729283    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b745520c-1dbd-4350-9be4-994400681c33","Type":"ContainerStarted","Data":"820dec09afecc5b71c4d345b1835a6981b1ef7e24f947472014ab673e5ab2752"}
Jul 20 02:51:11.729707 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.729310    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b745520c-1dbd-4350-9be4-994400681c33","Type":"ContainerStarted","Data":"cac29daf5c5e04cd0bdc786a7fa70bbc6b3fa348003831d8925487dc671a67a4"}
Jul 20 02:51:11.729707 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.729334    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b745520c-1dbd-4350-9be4-994400681c33","Type":"ContainerStarted","Data":"c094541465135bbe22f854d54d3a552156975aa7f88f51ef0eedd530cdb52827"}
Jul 20 02:51:11.729707 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.729355    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b745520c-1dbd-4350-9be4-994400681c33","Type":"ContainerStarted","Data":"3bf5f389686a85f469d04a578f8ad2fb3a86413a103ea2fe58ad48335b6c669f"}
Jul 20 02:51:11.729707 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.729379    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b745520c-1dbd-4350-9be4-994400681c33","Type":"ContainerStarted","Data":"ff78b7a59d465e9ba2918ffba07231d078760aaa8b53b5bf27eadf5634400485"}
Jul 20 02:51:11.752907 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.752860    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.733918406 podStartE2EDuration="2.752845433s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.927027ms" isStatefulPod=false podCreationTimestamp="2026-07-20 02:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:51:11.751542996 +0000 UTC m=+379.978311695" watchObservedRunningTime="2026-07-20 02:51:11.752845433 +0000 UTC m=+379.979614133"
Jul 20 02:51:11.829296 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.829254    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"
Jul 20 02:51:11.976526 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:11.976495    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c466df9c8-bzrnz"]
Jul 20 02:51:11.978808 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:51:11.978780    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70dc7872_a087_4a3d_b948_e9199504ec86.slice/crio-b3c96264fc15d0b602fe63c597045bcefb3f366f057fc82b6a4928e444f1036e WatchSource:0}: Error finding container b3c96264fc15d0b602fe63c597045bcefb3f366f057fc82b6a4928e444f1036e: Status 404 returned error can't find the container with id b3c96264fc15d0b602fe63c597045bcefb3f366f057fc82b6a4928e444f1036e
Jul 20 02:51:12.734502 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:12.734467    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz" event={"ID":"70dc7872-a087-4a3d-b948-e9199504ec86","Type":"ContainerStarted","Data":"b3c96264fc15d0b602fe63c597045bcefb3f366f057fc82b6a4928e444f1036e"}
Jul 20 02:51:14.745142 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:14.745103    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz" event={"ID":"70dc7872-a087-4a3d-b948-e9199504ec86","Type":"ContainerStarted","Data":"e4112e9d1413cbc0aaaac07c7eb6c532d9149515af93e34ed9d850ad693671e3"}
Jul 20 02:51:14.745502 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:14.745160    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz" event={"ID":"70dc7872-a087-4a3d-b948-e9199504ec86","Type":"ContainerStarted","Data":"24f1f3df7c9478b371ca2c73f69ac768bc6840de498c1dfee9b043550571f916"}
Jul 20 02:51:14.745502 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:14.745177    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz" event={"ID":"70dc7872-a087-4a3d-b948-e9199504ec86","Type":"ContainerStarted","Data":"84e5bd12b62dc8655a4b3dec774cbf3a5a4730f3978b7d5666154a6911d2b20d"}
Jul 20 02:51:14.764924 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:14.764848    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c466df9c8-bzrnz" podStartSLOduration=1.8627217950000001 podStartE2EDuration="3.764830047s" totalImagesPullingTime="1.902108252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:51:14.763534949 +0000 UTC m=+382.990303666" watchObservedRunningTime="2026-07-20 02:51:14.764830047 +0000 UTC m=+382.991598750"
Jul 20 02:51:15.524514 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.524481    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dfffcd788-5j4sm"]
Jul 20 02:51:15.527189 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.527167    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.536143 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.536087    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfffcd788-5j4sm"]
Jul 20 02:51:15.573569 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.573537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:15.623059 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.623028    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-service-ca\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.623216 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.623069    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-serving-cert\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.623216 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.623098    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-oauth-serving-cert\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.623216 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.623189    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-oauth-config\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.623328 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.623234    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-trusted-ca-bundle\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.623328 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.623272    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-config\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.623328 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.623294    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxpkh\" (UniqueName: \"kubernetes.io/projected/90eb20ca-70cf-4af1-be95-c94b06b2fd16-kube-api-access-cxpkh\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.674083 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.674053    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:15.724573 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.724539    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-serving-cert\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.724753 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.724582    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-oauth-serving-cert\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.724753 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.724610    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-oauth-config\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.724753 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.724665    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-trusted-ca-bundle\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.724753 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.724696    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-config\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.724753 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.724724    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxpkh\" (UniqueName: \"kubernetes.io/projected/90eb20ca-70cf-4af1-be95-c94b06b2fd16-kube-api-access-cxpkh\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.725018 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.724758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-service-ca\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.725583 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.725553    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-oauth-serving-cert\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.725764 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.725741    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-service-ca\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.725961 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.725935    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-config\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.726034 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.725943    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-trusted-ca-bundle\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.727226 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.727203    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-serving-cert\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.727311 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.727239    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-oauth-config\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.731916 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.731894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxpkh\" (UniqueName: \"kubernetes.io/projected/90eb20ca-70cf-4af1-be95-c94b06b2fd16-kube-api-access-cxpkh\") pod \"console-5dfffcd788-5j4sm\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") " pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.774742 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.774670    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:15.838865 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.838833    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:15.994405 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:15.994373    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfffcd788-5j4sm"]
Jul 20 02:51:15.997983 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:51:15.997959    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90eb20ca_70cf_4af1_be95_c94b06b2fd16.slice/crio-103207d242387a56e91f270ae509d8462dea4b3b8d63f2e11860d5bb7b2c021e WatchSource:0}: Error finding container 103207d242387a56e91f270ae509d8462dea4b3b8d63f2e11860d5bb7b2c021e: Status 404 returned error can't find the container with id 103207d242387a56e91f270ae509d8462dea4b3b8d63f2e11860d5bb7b2c021e
Jul 20 02:51:16.317551 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:16.317462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:16.366091 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:16.366070    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:16.756111 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:16.756020    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfffcd788-5j4sm" event={"ID":"90eb20ca-70cf-4af1-be95-c94b06b2fd16","Type":"ContainerStarted","Data":"05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71"}
Jul 20 02:51:16.756111 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:16.756076    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfffcd788-5j4sm" event={"ID":"90eb20ca-70cf-4af1-be95-c94b06b2fd16","Type":"ContainerStarted","Data":"103207d242387a56e91f270ae509d8462dea4b3b8d63f2e11860d5bb7b2c021e"}
Jul 20 02:51:16.772372 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:16.772329    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dfffcd788-5j4sm" podStartSLOduration=1.7723137329999998 podStartE2EDuration="1.772313733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:51:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:51:16.77156585 +0000 UTC m=+384.998334576" watchObservedRunningTime="2026-07-20 02:51:16.772313733 +0000 UTC m=+384.999082432"
Jul 20 02:51:20.837206 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:20.837177    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:20.891147 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:20.891123    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:21.661092 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:21.661062    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:21.713951 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:21.713925    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:25.839316 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:25.839284    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:25.839808 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:25.839339    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:25.843901 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:25.843880    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:26.797980 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:26.797952    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:51:26.869032 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:26.868997    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fbddb8b49-2ztdt"]
Jul 20 02:51:26.969926 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:26.969896    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:27.074507 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:27.074425    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:27.124928 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:27.124879    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:51:51.889989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:51.889916    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fbddb8b49-2ztdt" podUID="ae8979b5-60b2-4276-9bb3-d3a87947e96f" containerName="console" containerID="cri-o://201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1" gracePeriod=15
Jul 20 02:51:52.136409 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.136384    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:51:52.208997 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.208968    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-config\") pod \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") "
Jul 20 02:51:52.209126 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209020    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-oauth-serving-cert\") pod \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") "
Jul 20 02:51:52.209126 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209050    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-oauth-config\") pod \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") "
Jul 20 02:51:52.209126 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209088    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-trusted-ca-bundle\") pod \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") "
Jul 20 02:51:52.209126 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209118    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-service-ca\") pod \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") "
Jul 20 02:51:52.209295 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209171    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-serving-cert\") pod \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") "
Jul 20 02:51:52.209295 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209200    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rhmn\" (UniqueName: \"kubernetes.io/projected/ae8979b5-60b2-4276-9bb3-d3a87947e96f-kube-api-access-5rhmn\") pod \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\" (UID: \"ae8979b5-60b2-4276-9bb3-d3a87947e96f\") "
Jul 20 02:51:52.209375 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209306    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-config" (OuterVolumeSpecName: "console-config") pod "ae8979b5-60b2-4276-9bb3-d3a87947e96f" (UID: "ae8979b5-60b2-4276-9bb3-d3a87947e96f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:51:52.209431 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209401    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ae8979b5-60b2-4276-9bb3-d3a87947e96f" (UID: "ae8979b5-60b2-4276-9bb3-d3a87947e96f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:51:52.209487 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209439    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-config\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:52.209613 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209498    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ae8979b5-60b2-4276-9bb3-d3a87947e96f" (UID: "ae8979b5-60b2-4276-9bb3-d3a87947e96f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:51:52.209734 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.209665    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-service-ca" (OuterVolumeSpecName: "service-ca") pod "ae8979b5-60b2-4276-9bb3-d3a87947e96f" (UID: "ae8979b5-60b2-4276-9bb3-d3a87947e96f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:51:52.211446 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.211426    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ae8979b5-60b2-4276-9bb3-d3a87947e96f" (UID: "ae8979b5-60b2-4276-9bb3-d3a87947e96f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:51:52.211530 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.211453    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ae8979b5-60b2-4276-9bb3-d3a87947e96f" (UID: "ae8979b5-60b2-4276-9bb3-d3a87947e96f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:51:52.211530 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.211504    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae8979b5-60b2-4276-9bb3-d3a87947e96f-kube-api-access-5rhmn" (OuterVolumeSpecName: "kube-api-access-5rhmn") pod "ae8979b5-60b2-4276-9bb3-d3a87947e96f" (UID: "ae8979b5-60b2-4276-9bb3-d3a87947e96f"). InnerVolumeSpecName "kube-api-access-5rhmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 02:51:52.310411 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.310385    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-oauth-serving-cert\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:52.310411 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.310407    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-oauth-config\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:52.310411 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.310417    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-trusted-ca-bundle\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:52.310607 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.310426    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae8979b5-60b2-4276-9bb3-d3a87947e96f-service-ca\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:52.310607 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.310434    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae8979b5-60b2-4276-9bb3-d3a87947e96f-console-serving-cert\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:52.310607 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.310443    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rhmn\" (UniqueName: \"kubernetes.io/projected/ae8979b5-60b2-4276-9bb3-d3a87947e96f-kube-api-access-5rhmn\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:51:52.898498 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.898463    2584 generic.go:356] "Generic (PLEG): container finished" podID="ae8979b5-60b2-4276-9bb3-d3a87947e96f" containerID="201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1" exitCode=0
Jul 20 02:51:52.899000 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.898511    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbddb8b49-2ztdt"
Jul 20 02:51:52.899000 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.898548    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbddb8b49-2ztdt" event={"ID":"ae8979b5-60b2-4276-9bb3-d3a87947e96f","Type":"ContainerDied","Data":"201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1"}
Jul 20 02:51:52.899000 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.898594    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbddb8b49-2ztdt" event={"ID":"ae8979b5-60b2-4276-9bb3-d3a87947e96f","Type":"ContainerDied","Data":"9bf40556eabd76124543a0a8b3550787aff4104f1e8ba4ef4c2d3f937c8f9818"}
Jul 20 02:51:52.899000 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.898615    2584 scope.go:117] "RemoveContainer" containerID="201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1"
Jul 20 02:51:52.906387 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.906369    2584 scope.go:117] "RemoveContainer" containerID="201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1"
Jul 20 02:51:52.906605 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:51:52.906589    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1\": container with ID starting with 201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1 not found: ID does not exist" containerID="201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1"
Jul 20 02:51:52.906674 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.906611    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1"} err="failed to get container status \"201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1\": rpc error: code = NotFound desc = could not find container \"201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1\": container with ID starting with 201bde217a6cd882890571a1e0b73dbe8ea1a065ecd52294393de135e02f2cb1 not found: ID does not exist"
Jul 20 02:51:52.918490 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.914048    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fbddb8b49-2ztdt"]
Jul 20 02:51:52.918490 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:52.917774    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fbddb8b49-2ztdt"]
Jul 20 02:51:54.278875 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:51:54.278844    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae8979b5-60b2-4276-9bb3-d3a87947e96f" path="/var/lib/kubelet/pods/ae8979b5-60b2-4276-9bb3-d3a87947e96f/volumes"
Jul 20 02:52:21.669758 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:21.669683    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:21.716737 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:21.716708    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:33.660396 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:33.660364    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:33.710257 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:33.710230    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:33.934088 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:33.934009    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:36.543821 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.543791    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dcf759ddd-rfjxp"]
Jul 20 02:52:36.544190 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.544072    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae8979b5-60b2-4276-9bb3-d3a87947e96f" containerName="console"
Jul 20 02:52:36.544190 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.544081    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae8979b5-60b2-4276-9bb3-d3a87947e96f" containerName="console"
Jul 20 02:52:36.544190 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.544146    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae8979b5-60b2-4276-9bb3-d3a87947e96f" containerName="console"
Jul 20 02:52:36.547157 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.547140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.560129 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.560105    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcf759ddd-rfjxp"]
Jul 20 02:52:36.601393 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.601364    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:36.657839 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.657808    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-serving-cert\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.657973 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.657854    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-oauth-config\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.657973 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.657932    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-trusted-ca-bundle\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.658070 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.657974    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-service-ca\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.658070 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.658000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-console-config\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.658070 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.658027    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-oauth-serving-cert\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.658070 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.658043    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9bdc\" (UniqueName: \"kubernetes.io/projected/a26f05f5-af00-4e7a-b701-cae1ed644800-kube-api-access-g9bdc\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.705527 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.705500    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:36.759347 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.759317    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-trusted-ca-bundle\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.759474 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.759351    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-service-ca\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.759474 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.759369    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-console-config\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.759474 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.759390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-oauth-serving-cert\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.759474 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.759404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9bdc\" (UniqueName: \"kubernetes.io/projected/a26f05f5-af00-4e7a-b701-cae1ed644800-kube-api-access-g9bdc\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.759474 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.759433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-serving-cert\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.759474 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.759458    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-oauth-config\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.760178 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.760155    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-service-ca\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.760305 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.760194    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-console-config\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.760362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.760228    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-oauth-serving-cert\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.760362 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.760240    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-trusted-ca-bundle\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.762294 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.762275    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-oauth-config\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.762491 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.762470    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-serving-cert\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.767675 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.767633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9bdc\" (UniqueName: \"kubernetes.io/projected/a26f05f5-af00-4e7a-b701-cae1ed644800-kube-api-access-g9bdc\") pod \"console-7dcf759ddd-rfjxp\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") " pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.803114 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.803058    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:36.855956 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.855927    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:36.981326 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:36.981290    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcf759ddd-rfjxp"]
Jul 20 02:52:36.984301 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:52:36.984277    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26f05f5_af00_4e7a_b701_cae1ed644800.slice/crio-9ac33f31a44d28cb63819f1550251de9837caf4749fb8f77ffded90539976aaf WatchSource:0}: Error finding container 9ac33f31a44d28cb63819f1550251de9837caf4749fb8f77ffded90539976aaf: Status 404 returned error can't find the container with id 9ac33f31a44d28cb63819f1550251de9837caf4749fb8f77ffded90539976aaf
Jul 20 02:52:37.071914 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:37.071831    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcf759ddd-rfjxp" event={"ID":"a26f05f5-af00-4e7a-b701-cae1ed644800","Type":"ContainerStarted","Data":"1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555"}
Jul 20 02:52:37.071914 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:37.071884    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcf759ddd-rfjxp" event={"ID":"a26f05f5-af00-4e7a-b701-cae1ed644800","Type":"ContainerStarted","Data":"9ac33f31a44d28cb63819f1550251de9837caf4749fb8f77ffded90539976aaf"}
Jul 20 02:52:37.090768 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:37.090712    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dcf759ddd-rfjxp" podStartSLOduration=1.090694438 podStartE2EDuration="1.090694438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:52:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:52:37.089160458 +0000 UTC m=+465.315929180" watchObservedRunningTime="2026-07-20 02:52:37.090694438 +0000 UTC m=+465.317463139"
Jul 20 02:52:37.456630 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:37.456547    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:43.776385 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:43.776353    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:43.875143 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:43.875106    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:44.222280 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:44.222231    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:46.856968 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:46.856938    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:46.857465 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:46.857029    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:46.862633 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:46.862610    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:47.120394 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:47.120308    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:52:47.163597 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:47.163567    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfffcd788-5j4sm"]
Jul 20 02:52:47.258561 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:47.258530    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:52:47.305984 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:52:47.305957    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:12.190041 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.189985    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dfffcd788-5j4sm" podUID="90eb20ca-70cf-4af1-be95-c94b06b2fd16" containerName="console" containerID="cri-o://05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71" gracePeriod=15
Jul 20 02:53:12.437958 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.437930    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:53:12.555656 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.555616    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-oauth-config\") pod \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") "
Jul 20 02:53:12.555808 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.555665    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-service-ca\") pod \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") "
Jul 20 02:53:12.555808 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.555696    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-trusted-ca-bundle\") pod \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") "
Jul 20 02:53:12.555925 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.555886    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-oauth-serving-cert\") pod \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") "
Jul 20 02:53:12.555980 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.555929    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-config\") pod \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") "
Jul 20 02:53:12.556034 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.555987    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxpkh\" (UniqueName: \"kubernetes.io/projected/90eb20ca-70cf-4af1-be95-c94b06b2fd16-kube-api-access-cxpkh\") pod \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") "
Jul 20 02:53:12.556034 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.556007    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-service-ca" (OuterVolumeSpecName: "service-ca") pod "90eb20ca-70cf-4af1-be95-c94b06b2fd16" (UID: "90eb20ca-70cf-4af1-be95-c94b06b2fd16"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:53:12.556135 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.556052    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-serving-cert\") pod \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\" (UID: \"90eb20ca-70cf-4af1-be95-c94b06b2fd16\") "
Jul 20 02:53:12.556183 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.556152    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "90eb20ca-70cf-4af1-be95-c94b06b2fd16" (UID: "90eb20ca-70cf-4af1-be95-c94b06b2fd16"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:53:12.556254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.556227    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90eb20ca-70cf-4af1-be95-c94b06b2fd16" (UID: "90eb20ca-70cf-4af1-be95-c94b06b2fd16"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:53:12.556313 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.556234    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-config" (OuterVolumeSpecName: "console-config") pod "90eb20ca-70cf-4af1-be95-c94b06b2fd16" (UID: "90eb20ca-70cf-4af1-be95-c94b06b2fd16"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:53:12.556313 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.556298    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-service-ca\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:53:12.556421 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.556314    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-trusted-ca-bundle\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:53:12.556421 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.556327    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-oauth-serving-cert\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:53:12.556421 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.556336    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-config\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:53:12.557820 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.557784    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90eb20ca-70cf-4af1-be95-c94b06b2fd16" (UID: "90eb20ca-70cf-4af1-be95-c94b06b2fd16"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:53:12.558038 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.558013    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90eb20ca-70cf-4af1-be95-c94b06b2fd16-kube-api-access-cxpkh" (OuterVolumeSpecName: "kube-api-access-cxpkh") pod "90eb20ca-70cf-4af1-be95-c94b06b2fd16" (UID: "90eb20ca-70cf-4af1-be95-c94b06b2fd16"). InnerVolumeSpecName "kube-api-access-cxpkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 02:53:12.558130 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.558034    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90eb20ca-70cf-4af1-be95-c94b06b2fd16" (UID: "90eb20ca-70cf-4af1-be95-c94b06b2fd16"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:53:12.656692 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.656665    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-serving-cert\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:53:12.656692 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.656686    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90eb20ca-70cf-4af1-be95-c94b06b2fd16-console-oauth-config\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:53:12.656692 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:12.656695    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxpkh\" (UniqueName: \"kubernetes.io/projected/90eb20ca-70cf-4af1-be95-c94b06b2fd16-kube-api-access-cxpkh\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:53:13.213560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:13.213525    2584 generic.go:356] "Generic (PLEG): container finished" podID="90eb20ca-70cf-4af1-be95-c94b06b2fd16" containerID="05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71" exitCode=0
Jul 20 02:53:13.214018 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:13.213576    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfffcd788-5j4sm"
Jul 20 02:53:13.214018 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:13.213616    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfffcd788-5j4sm" event={"ID":"90eb20ca-70cf-4af1-be95-c94b06b2fd16","Type":"ContainerDied","Data":"05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71"}
Jul 20 02:53:13.214018 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:13.213705    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfffcd788-5j4sm" event={"ID":"90eb20ca-70cf-4af1-be95-c94b06b2fd16","Type":"ContainerDied","Data":"103207d242387a56e91f270ae509d8462dea4b3b8d63f2e11860d5bb7b2c021e"}
Jul 20 02:53:13.214018 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:13.213728    2584 scope.go:117] "RemoveContainer" containerID="05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71"
Jul 20 02:53:13.222144 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:13.222129    2584 scope.go:117] "RemoveContainer" containerID="05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71"
Jul 20 02:53:13.222406 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:53:13.222389    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71\": container with ID starting with 05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71 not found: ID does not exist" containerID="05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71"
Jul 20 02:53:13.222445 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:13.222417    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71"} err="failed to get container status \"05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71\": rpc error: code = NotFound desc = could not find container \"05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71\": container with ID starting with 05175cb6a6dffcd4ade0bad9341abfc2f0200ebfe67351e133c1c498881a2e71 not found: ID does not exist"
Jul 20 02:53:13.232285 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:13.232261    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfffcd788-5j4sm"]
Jul 20 02:53:13.235733 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:13.235715    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dfffcd788-5j4sm"]
Jul 20 02:53:14.278252 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:14.278219    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90eb20ca-70cf-4af1-be95-c94b06b2fd16" path="/var/lib/kubelet/pods/90eb20ca-70cf-4af1-be95-c94b06b2fd16/volumes"
Jul 20 02:53:28.931270 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:28.931236    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:29.030270 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:29.030225    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:30.644443 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:30.644404    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:50.503871 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:50.503840    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:51.254286 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:51.254243    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:52.425254 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.425222    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"]
Jul 20 02:53:52.425626 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.425567    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90eb20ca-70cf-4af1-be95-c94b06b2fd16" containerName="console"
Jul 20 02:53:52.425626 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.425578    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="90eb20ca-70cf-4af1-be95-c94b06b2fd16" containerName="console"
Jul 20 02:53:52.425723 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.425630    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="90eb20ca-70cf-4af1-be95-c94b06b2fd16" containerName="console"
Jul 20 02:53:52.428876 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.428861    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"
Jul 20 02:53:52.430977 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.430954    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 02:53:52.431117 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.431004    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 02:53:52.431248 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.431233    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tvbz9\""
Jul 20 02:53:52.440027 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.440004    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"]
Jul 20 02:53:52.581746 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.581713    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qwgz\" (UniqueName: \"kubernetes.io/projected/465ef943-eff6-4b19-969c-c8103f6598df-kube-api-access-8qwgz\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrglg\" (UID: \"465ef943-eff6-4b19-969c-c8103f6598df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"
Jul 20 02:53:52.581903 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.581780    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/465ef943-eff6-4b19-969c-c8103f6598df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrglg\" (UID: \"465ef943-eff6-4b19-969c-c8103f6598df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"
Jul 20 02:53:52.682683 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.682619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/465ef943-eff6-4b19-969c-c8103f6598df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrglg\" (UID: \"465ef943-eff6-4b19-969c-c8103f6598df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"
Jul 20 02:53:52.682852 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.682719    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qwgz\" (UniqueName: \"kubernetes.io/projected/465ef943-eff6-4b19-969c-c8103f6598df-kube-api-access-8qwgz\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrglg\" (UID: \"465ef943-eff6-4b19-969c-c8103f6598df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"
Jul 20 02:53:52.682999 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.682978    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/465ef943-eff6-4b19-969c-c8103f6598df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrglg\" (UID: \"465ef943-eff6-4b19-969c-c8103f6598df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"
Jul 20 02:53:52.693221 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.693196    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qwgz\" (UniqueName: \"kubernetes.io/projected/465ef943-eff6-4b19-969c-c8103f6598df-kube-api-access-8qwgz\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrglg\" (UID: \"465ef943-eff6-4b19-969c-c8103f6598df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"
Jul 20 02:53:52.737913 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.737878    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"
Jul 20 02:53:52.868679 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:52.868587    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg"]
Jul 20 02:53:52.872463 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:53:52.872436    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465ef943_eff6_4b19_969c_c8103f6598df.slice/crio-5d6b87b97e092bf423a7bfd10ed8703e5ebb25315f9b68d74d07faa9f4e09dd3 WatchSource:0}: Error finding container 5d6b87b97e092bf423a7bfd10ed8703e5ebb25315f9b68d74d07faa9f4e09dd3: Status 404 returned error can't find the container with id 5d6b87b97e092bf423a7bfd10ed8703e5ebb25315f9b68d74d07faa9f4e09dd3
Jul 20 02:53:53.372415 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:53.372376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg" event={"ID":"465ef943-eff6-4b19-969c-c8103f6598df","Type":"ContainerStarted","Data":"5d6b87b97e092bf423a7bfd10ed8703e5ebb25315f9b68d74d07faa9f4e09dd3"}
Jul 20 02:53:54.088725 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:54.088674    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:54.144715 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:54.144681    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:56.288853 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.288816    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:56.390414 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.390382    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg" event={"ID":"465ef943-eff6-4b19-969c-c8103f6598df","Type":"ContainerStarted","Data":"69a9122e07fbdc222b5e71186a73906035c83339aa8632b92afa0fa6f4818f85"}
Jul 20 02:53:56.390780 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.390755    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:56.400282 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.400258    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lrr8q"]
Jul 20 02:53:56.403571 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.403555    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:53:56.405386 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.405364    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 02:53:56.405509 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.405365    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-llwlw\""
Jul 20 02:53:56.405509 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.405365    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 02:53:56.410872 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.410824    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrglg" podStartSLOduration=1.803990453 podStartE2EDuration="4.410807563s" totalImagesPullingTime="2.60681711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:53:56.408960049 +0000 UTC m=+544.635728789" watchObservedRunningTime="2026-07-20 02:53:56.410807563 +0000 UTC m=+544.637576264"
Jul 20 02:53:56.413996 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.413974    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lrr8q"]
Jul 20 02:53:56.514951 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.514916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb080eba-a4e6-4ff1-9e41-7974c21afe58-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lrr8q\" (UID: \"bb080eba-a4e6-4ff1-9e41-7974c21afe58\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:53:56.514951 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.514951    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7frc\" (UniqueName: \"kubernetes.io/projected/bb080eba-a4e6-4ff1-9e41-7974c21afe58-kube-api-access-w7frc\") pod \"cert-manager-webhook-6486ffd997-lrr8q\" (UID: \"bb080eba-a4e6-4ff1-9e41-7974c21afe58\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:53:56.616129 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.616042    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb080eba-a4e6-4ff1-9e41-7974c21afe58-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lrr8q\" (UID: \"bb080eba-a4e6-4ff1-9e41-7974c21afe58\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:53:56.616129 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.616081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7frc\" (UniqueName: \"kubernetes.io/projected/bb080eba-a4e6-4ff1-9e41-7974c21afe58-kube-api-access-w7frc\") pod \"cert-manager-webhook-6486ffd997-lrr8q\" (UID: \"bb080eba-a4e6-4ff1-9e41-7974c21afe58\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:53:56.626404 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.626377    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7frc\" (UniqueName: \"kubernetes.io/projected/bb080eba-a4e6-4ff1-9e41-7974c21afe58-kube-api-access-w7frc\") pod \"cert-manager-webhook-6486ffd997-lrr8q\" (UID: \"bb080eba-a4e6-4ff1-9e41-7974c21afe58\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:53:56.626853 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.626833    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb080eba-a4e6-4ff1-9e41-7974c21afe58-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lrr8q\" (UID: \"bb080eba-a4e6-4ff1-9e41-7974c21afe58\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:53:56.724110 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.724075    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:53:56.795184 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.795152    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:56.865156 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.865125    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lrr8q"]
Jul 20 02:53:56.869224 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:53:56.869196    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb080eba_a4e6_4ff1_9e41_7974c21afe58.slice/crio-baa80e72ba6d4c40849015d9c3698eacddfedd889fa65701ddbfac63818054ce WatchSource:0}: Error finding container baa80e72ba6d4c40849015d9c3698eacddfedd889fa65701ddbfac63818054ce: Status 404 returned error can't find the container with id baa80e72ba6d4c40849015d9c3698eacddfedd889fa65701ddbfac63818054ce
Jul 20 02:53:56.899884 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:56.899837    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:57.396182 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:57.396146    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q" event={"ID":"bb080eba-a4e6-4ff1-9e41-7974c21afe58","Type":"ContainerStarted","Data":"baa80e72ba6d4c40849015d9c3698eacddfedd889fa65701ddbfac63818054ce"}
Jul 20 02:53:58.711276 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:58.711220    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:53:58.905984 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:53:58.905957    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:01.079388 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:01.079349    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:01.130446 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:01.130415    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:06.225353 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:06.225317    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:06.498756 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:06.498614    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:07.703872 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:07.703837    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:07.767167 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:07.767132    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:08.446081 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:08.445992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q" event={"ID":"bb080eba-a4e6-4ff1-9e41-7974c21afe58","Type":"ContainerStarted","Data":"9a4f3c48b911c0267bfbafb289c4788bd9806b2665e6c69d79bfe16b85b1a292"}
Jul 20 02:54:08.446231 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:08.446118    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:54:08.467168 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:08.467126    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q" podStartSLOduration=1.213805509 podStartE2EDuration="12.467112859s" totalImagesPullingTime="11.25330735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:54:08.465889249 +0000 UTC m=+556.692657955" watchObservedRunningTime="2026-07-20 02:54:08.467112859 +0000 UTC m=+556.693881560"
Jul 20 02:54:14.453200 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:14.453167    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lrr8q"
Jul 20 02:54:19.964586 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:19.964553    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:20.064599 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:20.064563    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:21.603329 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:21.603301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:24.210004 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:24.209972    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:24.265979 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:24.265949    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:33.889991 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:33.889963    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:33.990389 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:33.990352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:34.515875 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.515837    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:34.831057 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.831024    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"]
Jul 20 02:54:34.835428 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.835407    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:34.838152 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.838135    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 02:54:34.838294 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.838276    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 02:54:34.839841 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.839820    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lp5sr\""
Jul 20 02:54:34.839975 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.839863    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 02:54:34.839975 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.839884    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 02:54:34.854700 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.854675    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"]
Jul 20 02:54:34.892042 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.892012    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:34.901439 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.901414    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlmj7\" (UniqueName: \"kubernetes.io/projected/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-kube-api-access-hlmj7\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:34.901543 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.901478    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:34.901543 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.901515    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:34.901625 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.901554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-tmp\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:34.901691 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.901621    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-manifests\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:34.990622 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:34.990579    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:35.002778 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.002756    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlmj7\" (UniqueName: \"kubernetes.io/projected/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-kube-api-access-hlmj7\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.002850 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.002791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.002850 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.002810    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.003025 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.003004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-tmp\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.003105 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.003056    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-manifests\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.003405 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.003385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-manifests\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.005177 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.005158    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-tmp\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.005282 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.005267    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.005373 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.005356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.009951 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.009928    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlmj7\" (UniqueName: \"kubernetes.io/projected/f52c4128-4bc4-4d6e-b602-2c1d6e871fd0-kube-api-access-hlmj7\") pod \"opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2\" (UID: \"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.097682 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.097572    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:35.145404 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.145370    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:35.192106 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.192072    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:35.277655 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.277605    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"]
Jul 20 02:54:35.280528 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.280507    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:35.282576 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:54:35.282552    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52c4128_4bc4_4d6e_b602_2c1d6e871fd0.slice/crio-15f235eb8830324a3f48ecb6c9c9ee3147295f20f8d0584b56d08ca09bf100b1 WatchSource:0}: Error finding container 15f235eb8830324a3f48ecb6c9c9ee3147295f20f8d0584b56d08ca09bf100b1: Status 404 returned error can't find the container with id 15f235eb8830324a3f48ecb6c9c9ee3147295f20f8d0584b56d08ca09bf100b1
Jul 20 02:54:35.338885 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.338837    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:35.439778 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.439657    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:35.543911 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.543827    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:35.564133 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:35.564097    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2" event={"ID":"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0","Type":"ContainerStarted","Data":"15f235eb8830324a3f48ecb6c9c9ee3147295f20f8d0584b56d08ca09bf100b1"}
Jul 20 02:54:38.579782 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:38.579748    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2" event={"ID":"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0","Type":"ContainerStarted","Data":"534e99a9238a0830b8b55507a75a2bf6746aaae0d9692eb4d6d34b3321161a80"}
Jul 20 02:54:39.586568 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:39.586477    2584 generic.go:356] "Generic (PLEG): container finished" podID="f52c4128-4bc4-4d6e-b602-2c1d6e871fd0" containerID="534e99a9238a0830b8b55507a75a2bf6746aaae0d9692eb4d6d34b3321161a80" exitCode=0
Jul 20 02:54:39.586568 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:39.586537    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2" event={"ID":"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0","Type":"ContainerDied","Data":"534e99a9238a0830b8b55507a75a2bf6746aaae0d9692eb4d6d34b3321161a80"}
Jul 20 02:54:40.593306 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:40.593270    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2" event={"ID":"f52c4128-4bc4-4d6e-b602-2c1d6e871fd0","Type":"ContainerStarted","Data":"50b70298d5eac26359047e07f215d005bb48a9c66838779e006f79402bbc4019"}
Jul 20 02:54:40.593716 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:40.593435    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:40.611787 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:40.611724    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2" podStartSLOduration=2.167305362 podStartE2EDuration="6.611705782s" totalImagesPullingTime="3.380257479s" totalInitContainerRuntime="1.064142941s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:54:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:54:40.610880446 +0000 UTC m=+588.837649160" watchObservedRunningTime="2026-07-20 02:54:40.611705782 +0000 UTC m=+588.838474483"
Jul 20 02:54:43.817883 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:43.817852    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:43.935539 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:43.935507    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:51.600478 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:51.600447    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2"
Jul 20 02:54:53.868901 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:53.868866    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:53.979553 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:53.979512    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:54.285432 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.285402    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:54.350683 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.350635    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d88568984-mj96h"]
Jul 20 02:54:54.353864 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.353849    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.357515 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.357498    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 02:54:54.357616 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.357536    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 02:54:54.367286 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.367260    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d88568984-mj96h"]
Jul 20 02:54:54.464752 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.464713    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc112aee-e010-4ea0-9630-9d6ca975f1ce-tmp\") pod \"kube-auth-proxy-6d88568984-mj96h\" (UID: \"fc112aee-e010-4ea0-9630-9d6ca975f1ce\") " pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.464752 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.464754    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc112aee-e010-4ea0-9630-9d6ca975f1ce-tls-certs\") pod \"kube-auth-proxy-6d88568984-mj96h\" (UID: \"fc112aee-e010-4ea0-9630-9d6ca975f1ce\") " pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.465003 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.464866    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptj6\" (UniqueName: \"kubernetes.io/projected/fc112aee-e010-4ea0-9630-9d6ca975f1ce-kube-api-access-tptj6\") pod \"kube-auth-proxy-6d88568984-mj96h\" (UID: \"fc112aee-e010-4ea0-9630-9d6ca975f1ce\") " pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.525395 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.525363    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:54.565441 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.565353    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptj6\" (UniqueName: \"kubernetes.io/projected/fc112aee-e010-4ea0-9630-9d6ca975f1ce-kube-api-access-tptj6\") pod \"kube-auth-proxy-6d88568984-mj96h\" (UID: \"fc112aee-e010-4ea0-9630-9d6ca975f1ce\") " pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.565441 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.565410    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc112aee-e010-4ea0-9630-9d6ca975f1ce-tmp\") pod \"kube-auth-proxy-6d88568984-mj96h\" (UID: \"fc112aee-e010-4ea0-9630-9d6ca975f1ce\") " pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.565690 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.565445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc112aee-e010-4ea0-9630-9d6ca975f1ce-tls-certs\") pod \"kube-auth-proxy-6d88568984-mj96h\" (UID: \"fc112aee-e010-4ea0-9630-9d6ca975f1ce\") " pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.567613 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.567592    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc112aee-e010-4ea0-9630-9d6ca975f1ce-tmp\") pod \"kube-auth-proxy-6d88568984-mj96h\" (UID: \"fc112aee-e010-4ea0-9630-9d6ca975f1ce\") " pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.567855 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.567837    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc112aee-e010-4ea0-9630-9d6ca975f1ce-tls-certs\") pod \"kube-auth-proxy-6d88568984-mj96h\" (UID: \"fc112aee-e010-4ea0-9630-9d6ca975f1ce\") " pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.579678 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.579660    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptj6\" (UniqueName: \"kubernetes.io/projected/fc112aee-e010-4ea0-9630-9d6ca975f1ce-kube-api-access-tptj6\") pod \"kube-auth-proxy-6d88568984-mj96h\" (UID: \"fc112aee-e010-4ea0-9630-9d6ca975f1ce\") " pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.617066 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.617041    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-skc2d"]
Jul 20 02:54:54.620365 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.620352    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:54:54.622293 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.622270    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 20 02:54:54.622817 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.622791    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5s8ns\""
Jul 20 02:54:54.630502 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.630481    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-skc2d"]
Jul 20 02:54:54.656412 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.656385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:54.663124 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.663104    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h"
Jul 20 02:54:54.665967 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.665944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkrjx\" (UniqueName: \"kubernetes.io/projected/6573960a-43f6-449e-b041-68c30cfed3b8-kube-api-access-fkrjx\") pod \"odh-model-controller-7998c67dc4-skc2d\" (UID: \"6573960a-43f6-449e-b041-68c30cfed3b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:54:54.666107 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.666028    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6573960a-43f6-449e-b041-68c30cfed3b8-cert\") pod \"odh-model-controller-7998c67dc4-skc2d\" (UID: \"6573960a-43f6-449e-b041-68c30cfed3b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:54:54.759869 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.759836    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:54.767076 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.767040    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkrjx\" (UniqueName: \"kubernetes.io/projected/6573960a-43f6-449e-b041-68c30cfed3b8-kube-api-access-fkrjx\") pod \"odh-model-controller-7998c67dc4-skc2d\" (UID: \"6573960a-43f6-449e-b041-68c30cfed3b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:54:54.767264 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.767127    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6573960a-43f6-449e-b041-68c30cfed3b8-cert\") pod \"odh-model-controller-7998c67dc4-skc2d\" (UID: \"6573960a-43f6-449e-b041-68c30cfed3b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:54:54.769731 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.769708    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6573960a-43f6-449e-b041-68c30cfed3b8-cert\") pod \"odh-model-controller-7998c67dc4-skc2d\" (UID: \"6573960a-43f6-449e-b041-68c30cfed3b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:54:54.774688 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.774668    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkrjx\" (UniqueName: \"kubernetes.io/projected/6573960a-43f6-449e-b041-68c30cfed3b8-kube-api-access-fkrjx\") pod \"odh-model-controller-7998c67dc4-skc2d\" (UID: \"6573960a-43f6-449e-b041-68c30cfed3b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:54:54.798265 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.798228    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d88568984-mj96h"]
Jul 20 02:54:54.801045 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:54:54.801023    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc112aee_e010_4ea0_9630_9d6ca975f1ce.slice/crio-5092a02f78dbc9da624eef5915b3dc83c3b2d4b43f6f9ffcf42ac9d492f80d0a WatchSource:0}: Error finding container 5092a02f78dbc9da624eef5915b3dc83c3b2d4b43f6f9ffcf42ac9d492f80d0a: Status 404 returned error can't find the container with id 5092a02f78dbc9da624eef5915b3dc83c3b2d4b43f6f9ffcf42ac9d492f80d0a
Jul 20 02:54:54.863841 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.863767    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:54.933700 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:54.933664    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:54:55.059522 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.059499    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-skc2d"]
Jul 20 02:54:55.062173 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:54:55.062142    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6573960a_43f6_449e_b041_68c30cfed3b8.slice/crio-79c0bf4751bf42b000de1c24acea056cf43d3e9b2634990babdaa0a2953841b8 WatchSource:0}: Error finding container 79c0bf4751bf42b000de1c24acea056cf43d3e9b2634990babdaa0a2953841b8: Status 404 returned error can't find the container with id 79c0bf4751bf42b000de1c24acea056cf43d3e9b2634990babdaa0a2953841b8
Jul 20 02:54:55.135957 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.135891    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7gft5"]
Jul 20 02:54:55.140278 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.140259    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:54:55.142267 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.142250    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 20 02:54:55.148623 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.148581    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7gft5"]
Jul 20 02:54:55.149100 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.149072    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:55.270971 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.270940    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff584845-ed7b-4fb8-b41c-701c408c63c3-tls-certs\") pod \"model-serving-api-54d89bd5fc-7gft5\" (UID: \"ff584845-ed7b-4fb8-b41c-701c408c63c3\") " pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:54:55.271150 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.270992    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsqfw\" (UniqueName: \"kubernetes.io/projected/ff584845-ed7b-4fb8-b41c-701c408c63c3-kube-api-access-vsqfw\") pod \"model-serving-api-54d89bd5fc-7gft5\" (UID: \"ff584845-ed7b-4fb8-b41c-701c408c63c3\") " pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:54:55.322007 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.321976    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:55.372460 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.372422    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff584845-ed7b-4fb8-b41c-701c408c63c3-tls-certs\") pod \"model-serving-api-54d89bd5fc-7gft5\" (UID: \"ff584845-ed7b-4fb8-b41c-701c408c63c3\") " pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:54:55.372693 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.372671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsqfw\" (UniqueName: \"kubernetes.io/projected/ff584845-ed7b-4fb8-b41c-701c408c63c3-kube-api-access-vsqfw\") pod \"model-serving-api-54d89bd5fc-7gft5\" (UID: \"ff584845-ed7b-4fb8-b41c-701c408c63c3\") " pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:54:55.375465 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.375446    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff584845-ed7b-4fb8-b41c-701c408c63c3-tls-certs\") pod \"model-serving-api-54d89bd5fc-7gft5\" (UID: \"ff584845-ed7b-4fb8-b41c-701c408c63c3\") " pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:54:55.388902 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.388847    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsqfw\" (UniqueName: \"kubernetes.io/projected/ff584845-ed7b-4fb8-b41c-701c408c63c3-kube-api-access-vsqfw\") pod \"model-serving-api-54d89bd5fc-7gft5\" (UID: \"ff584845-ed7b-4fb8-b41c-701c408c63c3\") " pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:54:55.453197 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.453170    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:54:55.612179 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.612157    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7gft5"]
Jul 20 02:54:55.614554 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:54:55.614528    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff584845_ed7b_4fb8_b41c_701c408c63c3.slice/crio-b1e294dc0857c193852d24ce392fac50eb826637bbbffe3a4098c38b3e533403 WatchSource:0}: Error finding container b1e294dc0857c193852d24ce392fac50eb826637bbbffe3a4098c38b3e533403: Status 404 returned error can't find the container with id b1e294dc0857c193852d24ce392fac50eb826637bbbffe3a4098c38b3e533403
Jul 20 02:54:55.661755 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.661670    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h" event={"ID":"fc112aee-e010-4ea0-9630-9d6ca975f1ce","Type":"ContainerStarted","Data":"5092a02f78dbc9da624eef5915b3dc83c3b2d4b43f6f9ffcf42ac9d492f80d0a"}
Jul 20 02:54:55.663059 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.663030    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-skc2d" event={"ID":"6573960a-43f6-449e-b041-68c30cfed3b8","Type":"ContainerStarted","Data":"79c0bf4751bf42b000de1c24acea056cf43d3e9b2634990babdaa0a2953841b8"}
Jul 20 02:54:55.664165 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.664140    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7gft5" event={"ID":"ff584845-ed7b-4fb8-b41c-701c408c63c3","Type":"ContainerStarted","Data":"b1e294dc0857c193852d24ce392fac50eb826637bbbffe3a4098c38b3e533403"}
Jul 20 02:54:55.676090 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.676056    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:55.740795 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:55.740745    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:56.265719 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:56.265681    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:54:56.266544 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:56.266525    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:54:56.611412 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:56.611361    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:54:59.686533 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:59.686491    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h" event={"ID":"fc112aee-e010-4ea0-9630-9d6ca975f1ce","Type":"ContainerStarted","Data":"8688bd2a56b6ff0d5b2c9c44b624ed9c56979ebb4e08c0a0c3c954b8bd419ecb"}
Jul 20 02:54:59.687994 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:59.687967    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-skc2d" event={"ID":"6573960a-43f6-449e-b041-68c30cfed3b8","Type":"ContainerStarted","Data":"34407c1aa76ea610bf33b28eb01d10d96b7f72f73229fc298dab1f04ed122ae3"}
Jul 20 02:54:59.688127 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:59.688015    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:54:59.689276 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:59.689255    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7gft5" event={"ID":"ff584845-ed7b-4fb8-b41c-701c408c63c3","Type":"ContainerStarted","Data":"d63e1a02f0d7dc7a1bab0f3033e352f2ff3e3c3bc06f89c690b95fef64548595"}
Jul 20 02:54:59.689398 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:59.689378    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:54:59.722494 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:59.722445    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d88568984-mj96h" podStartSLOduration=1.666297516 podStartE2EDuration="5.722421788s" totalImagesPullingTime="4.056124272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:54:59.720720409 +0000 UTC m=+607.947489131" watchObservedRunningTime="2026-07-20 02:54:59.722421788 +0000 UTC m=+607.949190489"
Jul 20 02:54:59.740052 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:59.740005    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7gft5" podStartSLOduration=1.49106351 podStartE2EDuration="4.739989123s" totalImagesPullingTime="3.248925613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:54:59.738040927 +0000 UTC m=+607.964809628" watchObservedRunningTime="2026-07-20 02:54:59.739989123 +0000 UTC m=+607.966757823"
Jul 20 02:54:59.753695 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:54:59.753634    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-skc2d" podStartSLOduration=1.9412945480000001 podStartE2EDuration="5.75361596s" totalImagesPullingTime="3.812321412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:54:59.753250747 +0000 UTC m=+607.980019461" watchObservedRunningTime="2026-07-20 02:54:59.75361596 +0000 UTC m=+607.980384663"
Jul 20 02:55:01.665702 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.665664    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"]
Jul 20 02:55:01.669137 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.669121    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.671230 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.671203    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 02:55:01.671230 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.671205    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 02:55:01.671426 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.671286    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 02:55:01.671426 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.671354    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 02:55:01.671534 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.671468    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z4wqv\""
Jul 20 02:55:01.680584 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.680561    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"]
Jul 20 02:55:01.733308 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.733276    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.733491 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.733316    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.733491 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.733337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b641f054-9d7c-4ff5-9b00-401ba02062f7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.733491 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.733365    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b641f054-9d7c-4ff5-9b00-401ba02062f7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.733627 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.733500    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.733627 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.733560    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnclr\" (UniqueName: \"kubernetes.io/projected/b641f054-9d7c-4ff5-9b00-401ba02062f7-kube-api-access-nnclr\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.733627 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.733594    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.827287 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.827250    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:01.834416 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.834386    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b641f054-9d7c-4ff5-9b00-401ba02062f7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.834562 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.834457    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.834562 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.834507    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnclr\" (UniqueName: \"kubernetes.io/projected/b641f054-9d7c-4ff5-9b00-401ba02062f7-kube-api-access-nnclr\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.834562 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.834533    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.834802 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.834572    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.834802 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.834604    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.834802 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.834628    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b641f054-9d7c-4ff5-9b00-401ba02062f7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.835215 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.835188    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.836821 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.836791    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b641f054-9d7c-4ff5-9b00-401ba02062f7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.836905 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.836841    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b641f054-9d7c-4ff5-9b00-401ba02062f7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.837164 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.837144    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.837279 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.837261    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.846421 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.846398    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b641f054-9d7c-4ff5-9b00-401ba02062f7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.846508 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.846452    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnclr\" (UniqueName: \"kubernetes.io/projected/b641f054-9d7c-4ff5-9b00-401ba02062f7-kube-api-access-nnclr\") pod \"istiod-openshift-gateway-94bb8fbfd-gpvls\" (UID: \"b641f054-9d7c-4ff5-9b00-401ba02062f7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:01.978314 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:01.978235    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:02.130847 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:02.130821    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"]
Jul 20 02:55:02.132828 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:55:02.132799    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb641f054_9d7c_4ff5_9b00_401ba02062f7.slice/crio-311a4e13d1c8019568456c3120fc64a37731492953f8b7d2529c31c38897489b WatchSource:0}: Error finding container 311a4e13d1c8019568456c3120fc64a37731492953f8b7d2529c31c38897489b: Status 404 returned error can't find the container with id 311a4e13d1c8019568456c3120fc64a37731492953f8b7d2529c31c38897489b
Jul 20 02:55:02.134970 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:02.134954    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 02:55:02.705874 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:02.705833    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls" event={"ID":"b641f054-9d7c-4ff5-9b00-401ba02062f7","Type":"ContainerStarted","Data":"311a4e13d1c8019568456c3120fc64a37731492953f8b7d2529c31c38897489b"}
Jul 20 02:55:03.181935 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.181900    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"]
Jul 20 02:55:03.185420 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.185398    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.187611 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.187587    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 02:55:03.187743 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.187727    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 02:55:03.188290 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.188264    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 02:55:03.188455 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.188333    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 02:55:03.188455 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.188348    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tnjpf\""
Jul 20 02:55:03.188455 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.188447    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 02:55:03.192505 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.192484    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"]
Jul 20 02:55:03.248217 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.248174    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfbfm\" (UniqueName: \"kubernetes.io/projected/286c3444-0420-4d25-b64a-bdb67adfe4e9-kube-api-access-xfbfm\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.248394 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.248233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/286c3444-0420-4d25-b64a-bdb67adfe4e9-metrics-cert\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.248394 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.248266    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/286c3444-0420-4d25-b64a-bdb67adfe4e9-manager-config\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.248394 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.248337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/286c3444-0420-4d25-b64a-bdb67adfe4e9-cert\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.349057 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.349022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfbfm\" (UniqueName: \"kubernetes.io/projected/286c3444-0420-4d25-b64a-bdb67adfe4e9-kube-api-access-xfbfm\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.349266 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.349064    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/286c3444-0420-4d25-b64a-bdb67adfe4e9-metrics-cert\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.349266 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.349092    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/286c3444-0420-4d25-b64a-bdb67adfe4e9-manager-config\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.349266 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.349169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/286c3444-0420-4d25-b64a-bdb67adfe4e9-cert\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.349869 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.349848    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/286c3444-0420-4d25-b64a-bdb67adfe4e9-manager-config\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.351536 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.351513    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/286c3444-0420-4d25-b64a-bdb67adfe4e9-metrics-cert\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.351609 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.351556    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/286c3444-0420-4d25-b64a-bdb67adfe4e9-cert\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.357664 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.357629    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfbfm\" (UniqueName: \"kubernetes.io/projected/286c3444-0420-4d25-b64a-bdb67adfe4e9-kube-api-access-xfbfm\") pod \"lws-controller-manager-66bc978c4c-xg94l\" (UID: \"286c3444-0420-4d25-b64a-bdb67adfe4e9\") " pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.476815 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.476733    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:03.504227 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.504202    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:03.633084 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.633056    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"]
Jul 20 02:55:03.634845 ip-10-0-140-191 kubenswrapper[2584]: W0720 02:55:03.634819    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286c3444_0420_4d25_b64a_bdb67adfe4e9.slice/crio-2dd1ed01ed81b96ec52a60b7403962c6e424b3b31f47c9aefc022ae78ea226fe WatchSource:0}: Error finding container 2dd1ed01ed81b96ec52a60b7403962c6e424b3b31f47c9aefc022ae78ea226fe: Status 404 returned error can't find the container with id 2dd1ed01ed81b96ec52a60b7403962c6e424b3b31f47c9aefc022ae78ea226fe
Jul 20 02:55:03.712800 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:03.712756    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l" event={"ID":"286c3444-0420-4d25-b64a-bdb67adfe4e9","Type":"ContainerStarted","Data":"2dd1ed01ed81b96ec52a60b7403962c6e424b3b31f47c9aefc022ae78ea226fe"}
Jul 20 02:55:04.263477 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:04.263428    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:04.365804 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:04.365767    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:04.895063 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:04.895021    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:05.291133 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:05.291088    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:05.545560 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:05.545455    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:05.647055 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:05.647026    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:07.706722 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:07.706670    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 02:55:07.706989 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:07.706759    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 02:55:08.738104 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:08.738070    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l" event={"ID":"286c3444-0420-4d25-b64a-bdb67adfe4e9","Type":"ContainerStarted","Data":"d2719a7d09ff3fc36d0bd44193fcc5e48406f404869f10cd03bd407bd75bfab6"}
Jul 20 02:55:08.738566 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:08.738160    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:08.739707 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:08.739684    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls" event={"ID":"b641f054-9d7c-4ff5-9b00-401ba02062f7","Type":"ContainerStarted","Data":"82df7d34828c165e1da37617ac6c6cbf909a5cdc965f5b9daba47b1a687d2e44"}
Jul 20 02:55:08.739888 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:08.739868    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:08.741430 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:08.741408    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-gpvls container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 02:55:08.741523 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:08.741456    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls" podUID="b641f054-9d7c-4ff5-9b00-401ba02062f7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 02:55:08.753239 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:08.753200    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l" podStartSLOduration=1.627596256 podStartE2EDuration="5.753187323s" totalImagesPullingTime="4.125591067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:55:08.752158563 +0000 UTC m=+616.978927263" watchObservedRunningTime="2026-07-20 02:55:08.753187323 +0000 UTC m=+616.979956023"
Jul 20 02:55:08.770623 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:08.770557    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls" podStartSLOduration=2.199309318 podStartE2EDuration="7.770545987s" totalImagesPullingTime="5.571236669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 02:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 02:55:08.769195571 +0000 UTC m=+616.995964298" watchObservedRunningTime="2026-07-20 02:55:08.770545987 +0000 UTC m=+616.997314688"
Jul 20 02:55:09.744682 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:09.744633    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gpvls"
Jul 20 02:55:10.696734 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:10.696698    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-skc2d"
Jul 20 02:55:10.698687 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:10.698664    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7gft5"
Jul 20 02:55:19.745983 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:19.745909    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66bc978c4c-xg94l"
Jul 20 02:55:37.102953 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:37.102915    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:37.155233 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:37.155201    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:55.431752 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:55.431712    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:55.490343 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:55.490313    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:55.609050 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:55.609019    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:56.372257 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:56.372226    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:55:56.621014 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:55:56.620979    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:01.927824 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:01.927785    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:01.978177 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:01.978153    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:03.772659 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:03.772617    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:03.824269 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:03.824222    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:20.026937 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:20.026903    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:25.180071 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:25.180037    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:28.777829 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:28.777793    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:30.911634 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:30.911598    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcf759ddd-rfjxp"]
Jul 20 02:56:31.013857 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:31.013824    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:31.114349 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:31.114314    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:31.161406 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:31.161378    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:31.794671 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:31.794630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:33.247330 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:33.247279    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:33.412021 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:33.411987    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:33.999936 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:33.999898    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:36.626273 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:36.626230    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:36.730568 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:36.730537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:37.573043 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:37.573011    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:39.408874 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:39.408836    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:40.987050 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:40.987020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:41.094077 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:41.094041    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:41.500929 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:41.500897    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:41.784260 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:41.784234    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:43.377690 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:43.377660    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:43.477823 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:43.477789    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:44.578949 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:44.578866    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:44.699987 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:44.699959    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:53.801776 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:53.801738    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:53.899485 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:53.899450    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:55.932345 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:55.932306    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dcf759ddd-rfjxp" podUID="a26f05f5-af00-4e7a-b701-cae1ed644800" containerName="console" containerID="cri-o://1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555" gracePeriod=15
Jul 20 02:56:56.178380 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.178356    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:56:56.236598 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.236519    2584 generic.go:356] "Generic (PLEG): container finished" podID="a26f05f5-af00-4e7a-b701-cae1ed644800" containerID="1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555" exitCode=0
Jul 20 02:56:56.236598 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.236578    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcf759ddd-rfjxp"
Jul 20 02:56:56.236810 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.236603    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcf759ddd-rfjxp" event={"ID":"a26f05f5-af00-4e7a-b701-cae1ed644800","Type":"ContainerDied","Data":"1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555"}
Jul 20 02:56:56.236810 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.236684    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcf759ddd-rfjxp" event={"ID":"a26f05f5-af00-4e7a-b701-cae1ed644800","Type":"ContainerDied","Data":"9ac33f31a44d28cb63819f1550251de9837caf4749fb8f77ffded90539976aaf"}
Jul 20 02:56:56.236810 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.236714    2584 scope.go:117] "RemoveContainer" containerID="1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555"
Jul 20 02:56:56.245121 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.245098    2584 scope.go:117] "RemoveContainer" containerID="1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555"
Jul 20 02:56:56.245370 ip-10-0-140-191 kubenswrapper[2584]: E0720 02:56:56.245352    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555\": container with ID starting with 1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555 not found: ID does not exist" containerID="1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555"
Jul 20 02:56:56.245422 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.245382    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555"} err="failed to get container status \"1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555\": rpc error: code = NotFound desc = could not find container \"1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555\": container with ID starting with 1214363afc92bf1a622bdbfc794df647cd89e769b32b32d2cf88ed4430610555 not found: ID does not exist"
Jul 20 02:56:56.279235 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279213    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-oauth-serving-cert\") pod \"a26f05f5-af00-4e7a-b701-cae1ed644800\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") "
Jul 20 02:56:56.279363 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279246    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-service-ca\") pod \"a26f05f5-af00-4e7a-b701-cae1ed644800\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") "
Jul 20 02:56:56.279363 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279271    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-trusted-ca-bundle\") pod \"a26f05f5-af00-4e7a-b701-cae1ed644800\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") "
Jul 20 02:56:56.279363 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279312    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-oauth-config\") pod \"a26f05f5-af00-4e7a-b701-cae1ed644800\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") "
Jul 20 02:56:56.279363 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279356    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-console-config\") pod \"a26f05f5-af00-4e7a-b701-cae1ed644800\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") "
Jul 20 02:56:56.279678 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279411    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-serving-cert\") pod \"a26f05f5-af00-4e7a-b701-cae1ed644800\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") "
Jul 20 02:56:56.279678 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279449    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9bdc\" (UniqueName: \"kubernetes.io/projected/a26f05f5-af00-4e7a-b701-cae1ed644800-kube-api-access-g9bdc\") pod \"a26f05f5-af00-4e7a-b701-cae1ed644800\" (UID: \"a26f05f5-af00-4e7a-b701-cae1ed644800\") "
Jul 20 02:56:56.279678 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279582    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a26f05f5-af00-4e7a-b701-cae1ed644800" (UID: "a26f05f5-af00-4e7a-b701-cae1ed644800"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:56:56.279838 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279703    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-service-ca" (OuterVolumeSpecName: "service-ca") pod "a26f05f5-af00-4e7a-b701-cae1ed644800" (UID: "a26f05f5-af00-4e7a-b701-cae1ed644800"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:56:56.279899 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.279877    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-console-config" (OuterVolumeSpecName: "console-config") pod "a26f05f5-af00-4e7a-b701-cae1ed644800" (UID: "a26f05f5-af00-4e7a-b701-cae1ed644800"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:56:56.280107 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.280085    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a26f05f5-af00-4e7a-b701-cae1ed644800" (UID: "a26f05f5-af00-4e7a-b701-cae1ed644800"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 02:56:56.281695 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.281623    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26f05f5-af00-4e7a-b701-cae1ed644800-kube-api-access-g9bdc" (OuterVolumeSpecName: "kube-api-access-g9bdc") pod "a26f05f5-af00-4e7a-b701-cae1ed644800" (UID: "a26f05f5-af00-4e7a-b701-cae1ed644800"). InnerVolumeSpecName "kube-api-access-g9bdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 02:56:56.281695 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.281663    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a26f05f5-af00-4e7a-b701-cae1ed644800" (UID: "a26f05f5-af00-4e7a-b701-cae1ed644800"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:56:56.281825 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.281758    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a26f05f5-af00-4e7a-b701-cae1ed644800" (UID: "a26f05f5-af00-4e7a-b701-cae1ed644800"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 02:56:56.380361 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.380326    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-oauth-config\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:56:56.380361 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.380355    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-console-config\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:56:56.380361 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.380365    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26f05f5-af00-4e7a-b701-cae1ed644800-console-serving-cert\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:56:56.380596 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.380374    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9bdc\" (UniqueName: \"kubernetes.io/projected/a26f05f5-af00-4e7a-b701-cae1ed644800-kube-api-access-g9bdc\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:56:56.380596 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.380383    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-oauth-serving-cert\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:56:56.380596 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.380391    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-service-ca\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:56:56.380596 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.380398    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26f05f5-af00-4e7a-b701-cae1ed644800-trusted-ca-bundle\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 02:56:56.557032 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.557003    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcf759ddd-rfjxp"]
Jul 20 02:56:56.560987 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.560964    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dcf759ddd-rfjxp"]
Jul 20 02:56:56.793334 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.793289    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:56.893423 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:56.893341    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:58.278576 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:58.278544    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26f05f5-af00-4e7a-b701-cae1ed644800" path="/var/lib/kubelet/pods/a26f05f5-af00-4e7a-b701-cae1ed644800/volumes"
Jul 20 02:56:59.391061 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:59.391024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:56:59.491532 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:56:59.491498    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:03.014172 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:03.014141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:03.128533 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:03.128497    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:12.786031 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:12.786001    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:12.837024 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:12.836973    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:13.181940 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:13.181852    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:13.294944 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:13.294908    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:16.988367 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:16.988335    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:17.089051 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:17.089018    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:21.202994 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:21.202959    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:21.304834 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:21.304801    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:31.518820 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:31.518782    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:31.641263 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:31.641230    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:33.204803 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:33.204769    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:33.310716 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:33.310631    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:33.360691 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:33.360660    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:34.022940 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:34.022902    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:34.123772 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:34.123738    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:36.434072 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:36.434040    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:36.535462 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:36.535432    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:49.389430 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:49.389394    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:49.488862 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:49.488826    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:57:49.889325 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:57:49.889291    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:01.721849 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:01.721810    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:01.832394 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:01.832357    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:08.273208 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:08.273173    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:08.369630 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:08.369597    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:08.423677 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:08.423630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:09.127547 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:09.127514    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:12.235897 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:12.235865    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:12.334655 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:12.334611    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:43.868134 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:43.868057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:43.967626 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:43.967591    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:44.378414 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:44.378378    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:44.619593 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:44.619558    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:44.969418 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:44.969385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:45.072524 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:45.072489    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:55.431210 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:55.431176    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:58:55.529800 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:58:55.529768    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:59:06.056962 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:59:06.056923    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:59:24.950983 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:59:24.950949    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:59:37.383208 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:59:37.383172    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:59:39.654576 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:59:39.654544    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:59:44.277500 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:59:44.276835    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 02:59:56.298215 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:59:56.298188    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:59:56.299721 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:59:56.298281    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 02:59:56.847184 ip-10-0-140-191 kubenswrapper[2584]: I0720 02:59:56.847136    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:00:01.448449 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:00:01.448412    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:00:14.423265 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:00:14.423229    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:01:33.696018 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:01:33.695875    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:01:33.776249 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:01:33.776200    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:01:34.802409 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:01:34.802354    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:01:34.900820 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:01:34.900786    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:01:51.570385 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:01:51.570352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:02:09.322344 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:02:09.322305    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:02:42.353387 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:02:42.353355    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:03:19.950856 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:03:19.950813    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:03:20.000738 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:03:20.000692    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:03:38.798781 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:03:38.798729    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:03:40.069910 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:03:40.069835    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:15.704091 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:15.704010    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:15.801307 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:15.801279    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:15.943213 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:15.943181    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:21.685546 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:21.685517    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:21.744787 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:21.744732    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:21.808821 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:21.808773    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:21.908672 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:21.908630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:22.104937 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:22.104906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:27.633187 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:27.633142    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:27.733347 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:27.733303    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:04:56.329912 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:56.329796    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:04:56.333020 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:04:56.332257    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:05:41.290526 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:05:41.290494    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:06:16.475530 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:06:16.475495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:07:54.534419 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:07:54.534389    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:07:54.621365 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:07:54.621327    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:09:19.058784 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:09:19.058748    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:09:56.357046 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:09:56.356927    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:09:56.361323 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:09:56.361302    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:12:11.675900 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:11.675858    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:12:20.617344 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:20.617303    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:12:45.052937 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.052904    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"]
Jul 20 03:12:45.053435 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.053290    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26f05f5-af00-4e7a-b701-cae1ed644800" containerName="console"
Jul 20 03:12:45.053435 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.053302    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26f05f5-af00-4e7a-b701-cae1ed644800" containerName="console"
Jul 20 03:12:45.053435 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.053357    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26f05f5-af00-4e7a-b701-cae1ed644800" containerName="console"
Jul 20 03:12:45.056244 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.056229    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.058492 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.058472    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 03:12:45.058605 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.058495    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 03:12:45.059155 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.059138    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6tcpl\""
Jul 20 03:12:45.059238 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.059173    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-2eb3e7a8-kserve-self-signed-certs\""
Jul 20 03:12:45.065774 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.065756    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"]
Jul 20 03:12:45.094089 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.094058    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:12:45.144119 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.144090    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-home\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.144231 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.144127    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6jqg\" (UniqueName: \"kubernetes.io/projected/2436b3be-f137-4fab-8ebd-561230dccf53-kube-api-access-f6jqg\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.144231 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.144152    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-dshm\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.144302 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.144226    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-model-cache\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.144302 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.144256    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2436b3be-f137-4fab-8ebd-561230dccf53-tls-certs\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.144302 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.144284    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-tmp-dir\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.245633 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.245601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-tmp-dir\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.245824 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.245683    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-home\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.245824 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.245718    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6jqg\" (UniqueName: \"kubernetes.io/projected/2436b3be-f137-4fab-8ebd-561230dccf53-kube-api-access-f6jqg\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.245824 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.245747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-dshm\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.245824 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.245793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-model-cache\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.246026 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.245826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2436b3be-f137-4fab-8ebd-561230dccf53-tls-certs\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.246098 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.246073    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-tmp-dir\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.246158 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.246108    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-home\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.246215 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.246199    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-model-cache\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.248034 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.248007    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-dshm\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.248347 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.248327    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2436b3be-f137-4fab-8ebd-561230dccf53-tls-certs\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.252730 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.252711    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6jqg\" (UniqueName: \"kubernetes.io/projected/2436b3be-f137-4fab-8ebd-561230dccf53-kube-api-access-f6jqg\") pod \"e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") " pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.366684 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.366621    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:45.496786 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.496709    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"]
Jul 20 03:12:45.499037 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:12:45.498994    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2436b3be_f137_4fab_8ebd_561230dccf53.slice/crio-2d4748fc587ed45ba2ac66cb3c1495b32a840666d44a0e20215a6e23ffaca9d4 WatchSource:0}: Error finding container 2d4748fc587ed45ba2ac66cb3c1495b32a840666d44a0e20215a6e23ffaca9d4: Status 404 returned error can't find the container with id 2d4748fc587ed45ba2ac66cb3c1495b32a840666d44a0e20215a6e23ffaca9d4
Jul 20 03:12:45.501027 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.501006    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 03:12:45.562329 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:45.562297    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj" event={"ID":"2436b3be-f137-4fab-8ebd-561230dccf53","Type":"ContainerStarted","Data":"2d4748fc587ed45ba2ac66cb3c1495b32a840666d44a0e20215a6e23ffaca9d4"}
Jul 20 03:12:46.569720 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:46.569683    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj" event={"ID":"2436b3be-f137-4fab-8ebd-561230dccf53","Type":"ContainerStarted","Data":"8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3"}
Jul 20 03:12:46.584707 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:46.584627    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj" podStartSLOduration=0.592281743 podStartE2EDuration="1.584608297s" totalImagesPullingTime="992.326554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 03:12:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 03:12:46.583508499 +0000 UTC m=+1674.810277200" watchObservedRunningTime="2026-07-20 03:12:46.584608297 +0000 UTC m=+1674.811377017"
Jul 20 03:12:55.367677 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:55.367622    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:55.367677 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:55.367687    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:55.380117 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:55.380094    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:12:55.622989 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:12:55.622909    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:13:26.848014 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:26.847912    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:13:28.406050 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:28.406016    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"]
Jul 20 03:13:28.424714 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:28.424683    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:13:43.426401 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.426338    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj" podUID="2436b3be-f137-4fab-8ebd-561230dccf53" containerName="main" containerID="cri-o://8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3" gracePeriod=45
Jul 20 03:13:43.673814 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.673785    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:13:43.735345 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.735272    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-model-cache\") pod \"2436b3be-f137-4fab-8ebd-561230dccf53\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") "
Jul 20 03:13:43.735345 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.735304    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2436b3be-f137-4fab-8ebd-561230dccf53-tls-certs\") pod \"2436b3be-f137-4fab-8ebd-561230dccf53\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") "
Jul 20 03:13:43.735556 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.735350    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-home\") pod \"2436b3be-f137-4fab-8ebd-561230dccf53\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") "
Jul 20 03:13:43.735556 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.735369    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6jqg\" (UniqueName: \"kubernetes.io/projected/2436b3be-f137-4fab-8ebd-561230dccf53-kube-api-access-f6jqg\") pod \"2436b3be-f137-4fab-8ebd-561230dccf53\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") "
Jul 20 03:13:43.735556 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.735389    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-tmp-dir\") pod \"2436b3be-f137-4fab-8ebd-561230dccf53\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") "
Jul 20 03:13:43.735556 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.735407    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-dshm\") pod \"2436b3be-f137-4fab-8ebd-561230dccf53\" (UID: \"2436b3be-f137-4fab-8ebd-561230dccf53\") "
Jul 20 03:13:43.735801 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.735553    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-model-cache" (OuterVolumeSpecName: "model-cache") pod "2436b3be-f137-4fab-8ebd-561230dccf53" (UID: "2436b3be-f137-4fab-8ebd-561230dccf53"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:13:43.735801 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.735683    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-home" (OuterVolumeSpecName: "home") pod "2436b3be-f137-4fab-8ebd-561230dccf53" (UID: "2436b3be-f137-4fab-8ebd-561230dccf53"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:13:43.735801 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.735739    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2436b3be-f137-4fab-8ebd-561230dccf53" (UID: "2436b3be-f137-4fab-8ebd-561230dccf53"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:13:43.737569 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.737542    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2436b3be-f137-4fab-8ebd-561230dccf53-kube-api-access-f6jqg" (OuterVolumeSpecName: "kube-api-access-f6jqg") pod "2436b3be-f137-4fab-8ebd-561230dccf53" (UID: "2436b3be-f137-4fab-8ebd-561230dccf53"). InnerVolumeSpecName "kube-api-access-f6jqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:13:43.737697 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.737570    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-dshm" (OuterVolumeSpecName: "dshm") pod "2436b3be-f137-4fab-8ebd-561230dccf53" (UID: "2436b3be-f137-4fab-8ebd-561230dccf53"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:13:43.737697 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.737577    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2436b3be-f137-4fab-8ebd-561230dccf53-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2436b3be-f137-4fab-8ebd-561230dccf53" (UID: "2436b3be-f137-4fab-8ebd-561230dccf53"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 03:13:43.835990 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.835964    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-home\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:13:43.835990 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.835988    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6jqg\" (UniqueName: \"kubernetes.io/projected/2436b3be-f137-4fab-8ebd-561230dccf53-kube-api-access-f6jqg\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:13:43.836206 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.836000    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-tmp-dir\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:13:43.836206 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.836009    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-dshm\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:13:43.836206 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.836020    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2436b3be-f137-4fab-8ebd-561230dccf53-model-cache\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:13:43.836206 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.836034    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2436b3be-f137-4fab-8ebd-561230dccf53-tls-certs\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:13:43.836608 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.836581    2584 generic.go:356] "Generic (PLEG): container finished" podID="2436b3be-f137-4fab-8ebd-561230dccf53" containerID="8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3" exitCode=0
Jul 20 03:13:43.836713 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.836698    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"
Jul 20 03:13:43.836778 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.836730    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj" event={"ID":"2436b3be-f137-4fab-8ebd-561230dccf53","Type":"ContainerDied","Data":"8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3"}
Jul 20 03:13:43.836830 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.836781    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj" event={"ID":"2436b3be-f137-4fab-8ebd-561230dccf53","Type":"ContainerDied","Data":"2d4748fc587ed45ba2ac66cb3c1495b32a840666d44a0e20215a6e23ffaca9d4"}
Jul 20 03:13:43.836830 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.836804    2584 scope.go:117] "RemoveContainer" containerID="8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3"
Jul 20 03:13:43.845940 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.845920    2584 scope.go:117] "RemoveContainer" containerID="8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3"
Jul 20 03:13:43.846189 ip-10-0-140-191 kubenswrapper[2584]: E0720 03:13:43.846172    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3\": container with ID starting with 8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3 not found: ID does not exist" containerID="8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3"
Jul 20 03:13:43.846231 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.846198    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3"} err="failed to get container status \"8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3\": rpc error: code = NotFound desc = could not find container \"8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3\": container with ID starting with 8c5bd021b128530ae73f0eb7ed17a18004aa447544e4554cdedc7dc99e6777b3 not found: ID does not exist"
Jul 20 03:13:43.856155 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.856128    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"]
Jul 20 03:13:43.859476 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:43.859458    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-2eb3e7a8-kserve-65dbb5d99f-8nqgj"]
Jul 20 03:13:44.279497 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:13:44.279468    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2436b3be-f137-4fab-8ebd-561230dccf53" path="/var/lib/kubelet/pods/2436b3be-f137-4fab-8ebd-561230dccf53/volumes"
Jul 20 03:14:56.384225 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:14:56.384103    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:14:56.390854 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:14:56.390577    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:16:05.180122 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:16:05.180090    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:16:05.268280 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:16:05.268252    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:16:37.100017 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:16:37.099918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:16:42.618806 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:16:42.618773    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:16:50.906797 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:16:50.906762    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:16:56.126830 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:16:56.126797    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:16:59.509566 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:16:59.509533    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:16:59.609970 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:16:59.609935    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:00.007812 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:00.007770    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:06.104343 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:06.104300    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:06.161094 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:06.161062    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:06.372474 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:06.372385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:06.722220 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:06.722067    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:06.903764 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:06.903730    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:08.994954 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:08.994911    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:09.064265 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:09.064225    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:09.130706 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:09.130674    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:09.449618 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:09.449587    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:09.581500 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:09.581467    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:09.681501 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:09.681471    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:45.170881 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:45.170805    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:49.800499 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:49.800455    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:49.974738 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:49.974703    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:50.205852 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:50.205762    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:50.473980 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:50.473879    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:50.571943 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:50.571907    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:50.695317 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:50.695287    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:51.013831 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:51.013798    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:51.370796 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:51.370749    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:53.236155 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:53.236119    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:53.503835 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:53.503756    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:53.947579 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:53.947538    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:17:54.048818 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:17:54.048771    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:28.632330 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:28.632294    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:33.309587 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:33.309554    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:33.460862 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:33.460826    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:33.700015 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:33.699928    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:33.936412 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:33.936377    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:34.243999 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:34.243968    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:34.450884 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:34.450852    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:36.319963 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:36.319924    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:36.421374 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:36.421332    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:36.557278 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:36.557239    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:36.884337 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:36.884301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:37.002771 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:37.002741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:18:37.104617 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:18:37.104582    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:02.239960 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:02.239923    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:02.339169 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:02.339133    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:02.974769 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:02.974735    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:03.079496 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:03.079458    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:12.644817 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:12.644778    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:17.220748 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:17.220713    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:18.446146 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:18.446092    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:18.672343 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:18.672309    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:18.886867 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:18.886836    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:19.199968 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:19.199888    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:19.557550 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:19.557522    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:21.564243 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:21.564192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:21.642691 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:21.642656    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:21.708382 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:21.708344    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:22.125297 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:22.125261    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:22.227150 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:22.227081    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:22.327042 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:22.326994    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:19:56.412911 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:56.412793    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:19:56.418942 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:56.418921    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:19:57.032856 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:19:57.032821    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:01.621754 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:01.621719    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:01.809859 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:01.809826    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:02.081862 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:02.081828    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:02.602928 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:02.602890    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:02.701346 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:02.701315    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:02.807055 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:02.807024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:04.371224 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:04.371190    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:10.344017 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:10.343982    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:10.449055 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:10.448998    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:10.541418 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:10.541382    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:10.641467 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:10.641388    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:16.225572 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:16.225526    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:37.217441 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:37.217401    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:42.242589 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:42.242555    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:48.397243 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:48.397137    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:48.502886 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:48.502855    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:20:48.597758 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:20:48.597723    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:04.567855 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:04.567823    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:10.303515 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:10.303454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:10.403806 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:10.403774    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:10.503142 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:10.503092    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:21.118703 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:21.118654    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:22.004478 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:22.004444    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:24.027338 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:24.027293    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:24.128660 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:24.128606    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:28.348398 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:28.348367    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:28.457669 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:28.457621    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:28.547361 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:28.547319    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:28.649826 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:28.649744    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:29.571178 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:29.571125    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:29.671114 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:29.671076    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:29.770068 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:29.770027    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:31.579983 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:31.579954    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:37.720678 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:37.720617    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:37.822066 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:37.822032    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:38.396548 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:38.396513    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:44.126655 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:44.126614    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:44.228138 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:44.228103    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:44.413931 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:44.413851    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:44.740359 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:44.740285    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:45.241866 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:45.241833    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:47.924687 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:47.924648    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:48.021266 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:48.021218    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:48.085219 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:48.085182    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:48.228966 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:48.228894    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:48.675808 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:48.675775    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:48.778136 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:48.778099    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:52.439835 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:52.439797    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:53.210278 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:53.210247    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:53.309967 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:53.309937    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:53.677694 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:53.677630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:59.273944 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:59.273894    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:21:59.373735 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:21:59.373678    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:10.097257 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:10.097217    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:14.735490 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:14.735407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:15.126041 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:15.125999    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:20.757063 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:20.757024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:20.858515 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:20.858479    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:21.017658 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:21.017539    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:21.264339 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:21.264289    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:21.446615 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:21.446580    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:21.531572 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:21.531531    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:21.661971 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:21.661942    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:27.248633 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:27.248600    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:27.357730 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:27.357692    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:27.449010 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:27.448974    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:27.612339 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:27.612305    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:33.203803 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:33.203770    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:33.303829 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:33.303792    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:36.190406 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:36.190368    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:40.274336 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:40.274301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:40.624772 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:40.624740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:40.765443 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:40.765379    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:43.166356 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:43.166301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:43.244377 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:43.244341    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:43.307661 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:43.307609    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:43.605626 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:43.605584    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:43.718110 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:43.718076    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:43.818770 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:43.818736    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:22:47.696833 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:22:47.696801    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:23:09.630055 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.630021    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"]
Jul 20 03:23:09.630587 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.630380    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2436b3be-f137-4fab-8ebd-561230dccf53" containerName="main"
Jul 20 03:23:09.630587 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.630391    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2436b3be-f137-4fab-8ebd-561230dccf53" containerName="main"
Jul 20 03:23:09.630587 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.630461    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2436b3be-f137-4fab-8ebd-561230dccf53" containerName="main"
Jul 20 03:23:09.633436 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.633420    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.636029 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.635999    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-27c7795f\"/\"kube-root-ca.crt\""
Jul 20 03:23:09.636162 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.636000    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-27c7795f\"/\"e2e-lifecycle-model-27c7795f-kserve-self-signed-certs\""
Jul 20 03:23:09.636162 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.636085    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-27c7795f\"/\"openshift-service-ca.crt\""
Jul 20 03:23:09.636162 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.636133    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-27c7795f\"/\"default-dockercfg-dw7fm\""
Jul 20 03:23:09.641356 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.641334    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"]
Jul 20 03:23:09.660613 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.660590    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:23:09.682847 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.682825    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-tmp-dir\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.682922 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.682859    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-dshm\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.682922 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.682881    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1907a1e3-84a7-4e5d-90d1-0506841e3439-tls-certs\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.682922 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.682905    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-model-cache\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.683026 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.682993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-home\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.683077 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.683059    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljvwn\" (UniqueName: \"kubernetes.io/projected/1907a1e3-84a7-4e5d-90d1-0506841e3439-kube-api-access-ljvwn\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.784354 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.784322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1907a1e3-84a7-4e5d-90d1-0506841e3439-tls-certs\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.784354 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.784354    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-model-cache\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.784575 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.784397    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-home\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.784575 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.784434    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljvwn\" (UniqueName: \"kubernetes.io/projected/1907a1e3-84a7-4e5d-90d1-0506841e3439-kube-api-access-ljvwn\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.784575 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.784466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-tmp-dir\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.784575 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.784485    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-dshm\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.784877 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.784857    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-home\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.784949 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.784899    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-tmp-dir\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.784949 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.784940    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-model-cache\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.786723 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.786702    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-dshm\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.786870 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.786853    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1907a1e3-84a7-4e5d-90d1-0506841e3439-tls-certs\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.793281 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.793263    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljvwn\" (UniqueName: \"kubernetes.io/projected/1907a1e3-84a7-4e5d-90d1-0506841e3439-kube-api-access-ljvwn\") pod \"e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") " pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:09.943695 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:09.943584    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:10.072089 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:10.072057    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"]
Jul 20 03:23:10.074515 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:23:10.074492    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1907a1e3_84a7_4e5d_90d1_0506841e3439.slice/crio-1e2f1eb170ca39ff13ccfdfc581e06e31b477bbec61cb92dc55b16c92da786a7 WatchSource:0}: Error finding container 1e2f1eb170ca39ff13ccfdfc581e06e31b477bbec61cb92dc55b16c92da786a7: Status 404 returned error can't find the container with id 1e2f1eb170ca39ff13ccfdfc581e06e31b477bbec61cb92dc55b16c92da786a7
Jul 20 03:23:10.395372 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:10.395340    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9" event={"ID":"1907a1e3-84a7-4e5d-90d1-0506841e3439","Type":"ContainerStarted","Data":"db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7"}
Jul 20 03:23:10.395372 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:10.395380    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9" event={"ID":"1907a1e3-84a7-4e5d-90d1-0506841e3439","Type":"ContainerStarted","Data":"1e2f1eb170ca39ff13ccfdfc581e06e31b477bbec61cb92dc55b16c92da786a7"}
Jul 20 03:23:10.412965 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:10.412917    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9" podStartSLOduration=1.412902201 podStartE2EDuration="1.412902201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 03:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 03:23:10.411697914 +0000 UTC m=+2298.638466616" watchObservedRunningTime="2026-07-20 03:23:10.412902201 +0000 UTC m=+2298.639670948"
Jul 20 03:23:19.943915 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:19.943873    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:19.943915 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:19.943936    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:19.956268 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:19.956245    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:20.452302 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:20.452268    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:23:47.097599 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:47.097524    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:23:51.663324 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:51.663292    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:23:53.940510 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:53.940473    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:23:58.925664 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:58.925618    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"]
Jul 20 03:23:58.965866 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:23:58.965828    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:02.968254 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:02.968219    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:03.069685 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:03.069634    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:05.631250 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:05.631213    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:13.945823 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:13.945768    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9" podUID="1907a1e3-84a7-4e5d-90d1-0506841e3439" containerName="main" containerID="cri-o://db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7" gracePeriod=45
Jul 20 03:24:14.204222 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.204162    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:24:14.335161 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.335134    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-dshm\") pod \"1907a1e3-84a7-4e5d-90d1-0506841e3439\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") "
Jul 20 03:24:14.335161 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.335166    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-model-cache\") pod \"1907a1e3-84a7-4e5d-90d1-0506841e3439\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") "
Jul 20 03:24:14.335410 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.335215    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1907a1e3-84a7-4e5d-90d1-0506841e3439-tls-certs\") pod \"1907a1e3-84a7-4e5d-90d1-0506841e3439\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") "
Jul 20 03:24:14.335410 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.335238    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljvwn\" (UniqueName: \"kubernetes.io/projected/1907a1e3-84a7-4e5d-90d1-0506841e3439-kube-api-access-ljvwn\") pod \"1907a1e3-84a7-4e5d-90d1-0506841e3439\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") "
Jul 20 03:24:14.335410 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.335276    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-tmp-dir\") pod \"1907a1e3-84a7-4e5d-90d1-0506841e3439\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") "
Jul 20 03:24:14.335410 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.335329    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-home\") pod \"1907a1e3-84a7-4e5d-90d1-0506841e3439\" (UID: \"1907a1e3-84a7-4e5d-90d1-0506841e3439\") "
Jul 20 03:24:14.335617 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.335540    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-model-cache" (OuterVolumeSpecName: "model-cache") pod "1907a1e3-84a7-4e5d-90d1-0506841e3439" (UID: "1907a1e3-84a7-4e5d-90d1-0506841e3439"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:24:14.335677 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.335613    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1907a1e3-84a7-4e5d-90d1-0506841e3439" (UID: "1907a1e3-84a7-4e5d-90d1-0506841e3439"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:24:14.335731 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.335623    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-home" (OuterVolumeSpecName: "home") pod "1907a1e3-84a7-4e5d-90d1-0506841e3439" (UID: "1907a1e3-84a7-4e5d-90d1-0506841e3439"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:24:14.337503 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.337475    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1907a1e3-84a7-4e5d-90d1-0506841e3439-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1907a1e3-84a7-4e5d-90d1-0506841e3439" (UID: "1907a1e3-84a7-4e5d-90d1-0506841e3439"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 03:24:14.337503 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.337489    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-dshm" (OuterVolumeSpecName: "dshm") pod "1907a1e3-84a7-4e5d-90d1-0506841e3439" (UID: "1907a1e3-84a7-4e5d-90d1-0506841e3439"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:24:14.337503 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.337499    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1907a1e3-84a7-4e5d-90d1-0506841e3439-kube-api-access-ljvwn" (OuterVolumeSpecName: "kube-api-access-ljvwn") pod "1907a1e3-84a7-4e5d-90d1-0506841e3439" (UID: "1907a1e3-84a7-4e5d-90d1-0506841e3439"). InnerVolumeSpecName "kube-api-access-ljvwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:24:14.436308 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.436269    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-home\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:24:14.436308 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.436300    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-dshm\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:24:14.436308 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.436309    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-model-cache\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:24:14.436308 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.436319    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1907a1e3-84a7-4e5d-90d1-0506841e3439-tls-certs\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:24:14.436577 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.436328    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljvwn\" (UniqueName: \"kubernetes.io/projected/1907a1e3-84a7-4e5d-90d1-0506841e3439-kube-api-access-ljvwn\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:24:14.436577 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.436336    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1907a1e3-84a7-4e5d-90d1-0506841e3439-tmp-dir\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:24:14.690633 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.690596    2584 generic.go:356] "Generic (PLEG): container finished" podID="1907a1e3-84a7-4e5d-90d1-0506841e3439" containerID="db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7" exitCode=0
Jul 20 03:24:14.690813 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.690652    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"
Jul 20 03:24:14.690813 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.690667    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9" event={"ID":"1907a1e3-84a7-4e5d-90d1-0506841e3439","Type":"ContainerDied","Data":"db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7"}
Jul 20 03:24:14.690813 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.690713    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9" event={"ID":"1907a1e3-84a7-4e5d-90d1-0506841e3439","Type":"ContainerDied","Data":"1e2f1eb170ca39ff13ccfdfc581e06e31b477bbec61cb92dc55b16c92da786a7"}
Jul 20 03:24:14.690813 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.690728    2584 scope.go:117] "RemoveContainer" containerID="db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7"
Jul 20 03:24:14.699389 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.699371    2584 scope.go:117] "RemoveContainer" containerID="db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7"
Jul 20 03:24:14.699628 ip-10-0-140-191 kubenswrapper[2584]: E0720 03:24:14.699610    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7\": container with ID starting with db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7 not found: ID does not exist" containerID="db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7"
Jul 20 03:24:14.699767 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.699661    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7"} err="failed to get container status \"db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7\": rpc error: code = NotFound desc = could not find container \"db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7\": container with ID starting with db4e02764271b4ab1a31057ef393ba7d40cc0e626d7566209d1de89e6c3dc0b7 not found: ID does not exist"
Jul 20 03:24:14.710003 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.709979    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"]
Jul 20 03:24:14.715869 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:14.715849    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-27c7795f/e2e-lifecycle-model-27c7795f-kserve-64f49c647-xnjc9"]
Jul 20 03:24:16.279861 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:16.279828    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1907a1e3-84a7-4e5d-90d1-0506841e3439" path="/var/lib/kubelet/pods/1907a1e3-84a7-4e5d-90d1-0506841e3439/volumes"
Jul 20 03:24:35.060856 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:35.060824    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:36.081019 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:36.080975    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:41.642863 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:41.642823    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:47.768470 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:47.768434    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:47.868818 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:47.868787    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:48.105691 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:48.105629    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:48.313102 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:48.313069    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:49.517749 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:49.517703    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:49.614069 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:49.614031    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:49.713325 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:49.713289    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:49.816050 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:49.816013    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:50.527982 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:50.527949    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:50.616656 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:50.616619    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:52.108505 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:52.108474    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:56.440130 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:56.440021    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:24:56.446716 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:56.446135    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:24:57.830730 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:57.830690    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:57.930746 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:57.930713    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:24:58.520434 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:24:58.520395    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:04.528011 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:04.527972    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:04.639257 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:04.639225    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:04.729022 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:04.728990    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:15.265630 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:15.265549    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:15.612218 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:15.612183    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:36.636283 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:36.636249    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:43.162900 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:43.162863    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:43.280731 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:43.280697    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:43.558339 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:43.558310    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:43.884177 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:43.884102    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:44.121565 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:44.121511    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:47.175785 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:47.175748    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:47.275191 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:47.275158    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:47.343942 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:47.343907    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:47.568175 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:47.568148    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:47.913216 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:47.913110    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:48.029220 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:48.029188    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:51.656165 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:51.656128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:52.026709 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:52.026597    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:52.340933 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:52.340893    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:52.546795 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:52.546766    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:55.228805 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:55.228750    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:55.330264 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:55.330200    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:55.468329 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:55.468299    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:55.568774 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:55.568734    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:55.938016 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:55.937926    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:56.036320 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:56.036289    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:25:59.749280 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:25:59.749246    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:26:06.189601 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:06.189539    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:26:06.300370 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:06.300328    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:26:08.667429 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:08.667380    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:26:08.774213 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:08.774178    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:26:09.027177 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.027102    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"]
Jul 20 03:26:09.027466 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.027454    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1907a1e3-84a7-4e5d-90d1-0506841e3439" containerName="main"
Jul 20 03:26:09.027512 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.027468    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1907a1e3-84a7-4e5d-90d1-0506841e3439" containerName="main"
Jul 20 03:26:09.027548 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.027528    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1907a1e3-84a7-4e5d-90d1-0506841e3439" containerName="main"
Jul 20 03:26:09.030550 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.030523    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.032655 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.032619    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-da51e5\"/\"kube-root-ca.crt\""
Jul 20 03:26:09.033285 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.033266    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-da51e5\"/\"default-dockercfg-97xbl\""
Jul 20 03:26:09.033500 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.033477    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-da51e5\"/\"test-model-da51e5-kserve-self-signed-certs\""
Jul 20 03:26:09.033623 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.033584    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-da51e5\"/\"openshift-service-ca.crt\""
Jul 20 03:26:09.047533 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.047503    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"]
Jul 20 03:26:09.071609 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.071581    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:26:09.114069 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.114041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-home\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.114207 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.114075    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-model-cache\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.114207 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.114095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tls-certs\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.114207 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.114171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-dshm\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.114314 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.114207    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d6tj\" (UniqueName: \"kubernetes.io/projected/57bc5baf-04c8-40ed-aa42-6166bd2a9353-kube-api-access-4d6tj\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.114314 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.114233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tmp-dir\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.215603 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.215570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d6tj\" (UniqueName: \"kubernetes.io/projected/57bc5baf-04c8-40ed-aa42-6166bd2a9353-kube-api-access-4d6tj\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.215787 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.215622    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tmp-dir\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.215787 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.215709    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-home\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.215787 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.215744    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-model-cache\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.215787 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.215771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tls-certs\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.215963 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.215840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-dshm\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.216110 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.216084    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tmp-dir\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.216176 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.216106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-home\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.216234 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.216187    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-model-cache\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.218192 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.218170    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-dshm\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.218394 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.218374    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tls-certs\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.223945 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.223900    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d6tj\" (UniqueName: \"kubernetes.io/projected/57bc5baf-04c8-40ed-aa42-6166bd2a9353-kube-api-access-4d6tj\") pod \"test-model-da51e5-kserve-6b7898fcc5-8gvdg\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") " pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.339621 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.339587    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:09.472062 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:09.472038    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"]
Jul 20 03:26:09.474608 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:26:09.474577    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57bc5baf_04c8_40ed_aa42_6166bd2a9353.slice/crio-5c5e510383b08fa6cf0324074d2cf2a5d337d51ea553342f79f0ea58aefad760 WatchSource:0}: Error finding container 5c5e510383b08fa6cf0324074d2cf2a5d337d51ea553342f79f0ea58aefad760: Status 404 returned error can't find the container with id 5c5e510383b08fa6cf0324074d2cf2a5d337d51ea553342f79f0ea58aefad760
Jul 20 03:26:10.223913 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:10.223873    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg" event={"ID":"57bc5baf-04c8-40ed-aa42-6166bd2a9353","Type":"ContainerStarted","Data":"df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e"}
Jul 20 03:26:10.224292 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:10.223925    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg" event={"ID":"57bc5baf-04c8-40ed-aa42-6166bd2a9353","Type":"ContainerStarted","Data":"5c5e510383b08fa6cf0324074d2cf2a5d337d51ea553342f79f0ea58aefad760"}
Jul 20 03:26:10.240136 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:10.240089    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg" podStartSLOduration=1.240071639 podStartE2EDuration="1.240071639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 03:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 03:26:10.238199504 +0000 UTC m=+2478.464968218" watchObservedRunningTime="2026-07-20 03:26:10.240071639 +0000 UTC m=+2478.466840341"
Jul 20 03:26:16.984077 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:16.984042    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:26:17.082058 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:17.082020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:26:19.340747 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:19.340689    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:19.340747 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:19.340749    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:19.353035 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:19.353006    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:20.284982 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:20.284946    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:26:43.730346 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.730311    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"]
Jul 20 03:26:43.733859 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.733838    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.736468 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.736442    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-9fe24f\"/\"test-model-9fe24f-kserve-self-signed-certs\""
Jul 20 03:26:43.736588 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.736471    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-9fe24f\"/\"kube-root-ca.crt\""
Jul 20 03:26:43.736588 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.736488    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-9fe24f\"/\"default-dockercfg-pdrx9\""
Jul 20 03:26:43.736759 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.736744    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-9fe24f\"/\"openshift-service-ca.crt\""
Jul 20 03:26:43.744292 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.744273    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"]
Jul 20 03:26:43.755947 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.755916    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:26:43.829001 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.828968    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-home\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.829187 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.829010    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-model-cache\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.829187 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.829043    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xswth\" (UniqueName: \"kubernetes.io/projected/25076512-833b-4fd6-8367-e6ecc6aec650-kube-api-access-xswth\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.829187 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.829066    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25076512-833b-4fd6-8367-e6ecc6aec650-tls-certs\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.829187 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.829121    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-tmp-dir\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.829187 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.829145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-dshm\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.930290 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.930251    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-home\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.930480 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.930294    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-model-cache\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.930480 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.930328    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xswth\" (UniqueName: \"kubernetes.io/projected/25076512-833b-4fd6-8367-e6ecc6aec650-kube-api-access-xswth\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.930480 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.930350    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25076512-833b-4fd6-8367-e6ecc6aec650-tls-certs\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.930480 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.930367    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-tmp-dir\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.930480 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.930391    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-dshm\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.930997 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.930750    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-home\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.930997 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.930764    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-model-cache\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.930997 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.930851    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-tmp-dir\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.932743 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.932718    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-dshm\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.932841 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.932808    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25076512-833b-4fd6-8367-e6ecc6aec650-tls-certs\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:43.938300 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:43.938282    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xswth\" (UniqueName: \"kubernetes.io/projected/25076512-833b-4fd6-8367-e6ecc6aec650-kube-api-access-xswth\") pod \"test-model-9fe24f-kserve-798d6655d9-5ldtj\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") " pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:44.044574 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:44.044542    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:44.173005 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:44.172932    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"]
Jul 20 03:26:44.178480 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:26:44.178451    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25076512_833b_4fd6_8367_e6ecc6aec650.slice/crio-c449f38c8c39a9c1a04706d0b57fff8fafdcd3939a949687ae259145e0aa9bcf WatchSource:0}: Error finding container c449f38c8c39a9c1a04706d0b57fff8fafdcd3939a949687ae259145e0aa9bcf: Status 404 returned error can't find the container with id c449f38c8c39a9c1a04706d0b57fff8fafdcd3939a949687ae259145e0aa9bcf
Jul 20 03:26:44.381736 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:44.381633    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj" event={"ID":"25076512-833b-4fd6-8367-e6ecc6aec650","Type":"ContainerStarted","Data":"fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d"}
Jul 20 03:26:44.381736 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:44.381696    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj" event={"ID":"25076512-833b-4fd6-8367-e6ecc6aec650","Type":"ContainerStarted","Data":"c449f38c8c39a9c1a04706d0b57fff8fafdcd3939a949687ae259145e0aa9bcf"}
Jul 20 03:26:44.400143 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:44.400075    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj" podStartSLOduration=1.400056672 podStartE2EDuration="1.400056672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 03:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 03:26:44.399976104 +0000 UTC m=+2512.626744806" watchObservedRunningTime="2026-07-20 03:26:44.400056672 +0000 UTC m=+2512.626825376"
Jul 20 03:26:54.045613 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:54.045568    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:54.046057 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:54.045659    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:54.057963 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:54.057935    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:26:54.438699 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:26:54.438594    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:27:09.155752 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:09.155715    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"]
Jul 20 03:27:09.169084 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:09.169047    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:10.009895 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:10.009862    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"]
Jul 20 03:27:10.031778 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:10.031752    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:10.652904 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:10.652870    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:10.752997 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:10.752967    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:20.665915 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:20.665883    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:24.175676 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.175593    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg" podUID="57bc5baf-04c8-40ed-aa42-6166bd2a9353" containerName="main" containerID="cri-o://df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e" gracePeriod=45
Jul 20 03:27:24.426894 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.426837    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:27:24.562685 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.562650    2584 generic.go:356] "Generic (PLEG): container finished" podID="57bc5baf-04c8-40ed-aa42-6166bd2a9353" containerID="df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e" exitCode=0
Jul 20 03:27:24.562847 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.562696    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"
Jul 20 03:27:24.562847 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.562726    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg" event={"ID":"57bc5baf-04c8-40ed-aa42-6166bd2a9353","Type":"ContainerDied","Data":"df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e"}
Jul 20 03:27:24.562847 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.562769    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg" event={"ID":"57bc5baf-04c8-40ed-aa42-6166bd2a9353","Type":"ContainerDied","Data":"5c5e510383b08fa6cf0324074d2cf2a5d337d51ea553342f79f0ea58aefad760"}
Jul 20 03:27:24.562847 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.562787    2584 scope.go:117] "RemoveContainer" containerID="df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e"
Jul 20 03:27:24.574097 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.574082    2584 scope.go:117] "RemoveContainer" containerID="df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e"
Jul 20 03:27:24.574331 ip-10-0-140-191 kubenswrapper[2584]: E0720 03:27:24.574314    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e\": container with ID starting with df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e not found: ID does not exist" containerID="df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e"
Jul 20 03:27:24.574381 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.574340    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e"} err="failed to get container status \"df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e\": rpc error: code = NotFound desc = could not find container \"df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e\": container with ID starting with df41c0bc655ef176d5ad5b7ea0b618b200a83674df6d917f5de42da167f25f3e not found: ID does not exist"
Jul 20 03:27:24.599804 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.599782    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-dshm\") pod \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") "
Jul 20 03:27:24.599888 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.599826    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-home\") pod \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") "
Jul 20 03:27:24.599888 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.599860    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tls-certs\") pod \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") "
Jul 20 03:27:24.599981 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.599889    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-model-cache\") pod \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") "
Jul 20 03:27:24.599981 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.599932    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d6tj\" (UniqueName: \"kubernetes.io/projected/57bc5baf-04c8-40ed-aa42-6166bd2a9353-kube-api-access-4d6tj\") pod \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") "
Jul 20 03:27:24.599981 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.599980    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tmp-dir\") pod \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\" (UID: \"57bc5baf-04c8-40ed-aa42-6166bd2a9353\") "
Jul 20 03:27:24.600134 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.600065    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-home" (OuterVolumeSpecName: "home") pod "57bc5baf-04c8-40ed-aa42-6166bd2a9353" (UID: "57bc5baf-04c8-40ed-aa42-6166bd2a9353"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:27:24.600241 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.600200    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-model-cache" (OuterVolumeSpecName: "model-cache") pod "57bc5baf-04c8-40ed-aa42-6166bd2a9353" (UID: "57bc5baf-04c8-40ed-aa42-6166bd2a9353"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:27:24.600241 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.600232    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-home\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:24.600397 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.600260    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57bc5baf-04c8-40ed-aa42-6166bd2a9353" (UID: "57bc5baf-04c8-40ed-aa42-6166bd2a9353"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:27:24.602006 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.601982    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-dshm" (OuterVolumeSpecName: "dshm") pod "57bc5baf-04c8-40ed-aa42-6166bd2a9353" (UID: "57bc5baf-04c8-40ed-aa42-6166bd2a9353"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:27:24.602104 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.602073    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57bc5baf-04c8-40ed-aa42-6166bd2a9353-kube-api-access-4d6tj" (OuterVolumeSpecName: "kube-api-access-4d6tj") pod "57bc5baf-04c8-40ed-aa42-6166bd2a9353" (UID: "57bc5baf-04c8-40ed-aa42-6166bd2a9353"). InnerVolumeSpecName "kube-api-access-4d6tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:27:24.602148 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.602135    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57bc5baf-04c8-40ed-aa42-6166bd2a9353" (UID: "57bc5baf-04c8-40ed-aa42-6166bd2a9353"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 03:27:24.701369 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.701288    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tls-certs\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:24.701369 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.701316    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-model-cache\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:24.701369 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.701326    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d6tj\" (UniqueName: \"kubernetes.io/projected/57bc5baf-04c8-40ed-aa42-6166bd2a9353-kube-api-access-4d6tj\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:24.701369 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.701336    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-tmp-dir\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:24.701369 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.701351    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57bc5baf-04c8-40ed-aa42-6166bd2a9353-dshm\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:24.883069 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.883040    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"]
Jul 20 03:27:24.888466 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:24.888439    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-da51e5/test-model-da51e5-kserve-6b7898fcc5-8gvdg"]
Jul 20 03:27:25.030020 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.029907    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj" podUID="25076512-833b-4fd6-8367-e6ecc6aec650" containerName="main" containerID="cri-o://fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d" gracePeriod=45
Jul 20 03:27:25.259708 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.259669    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:25.282935 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.282914    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:27:25.408686 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.408623    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-dshm\") pod \"25076512-833b-4fd6-8367-e6ecc6aec650\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") "
Jul 20 03:27:25.408890 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.408713    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-model-cache\") pod \"25076512-833b-4fd6-8367-e6ecc6aec650\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") "
Jul 20 03:27:25.408890 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.408731    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-tmp-dir\") pod \"25076512-833b-4fd6-8367-e6ecc6aec650\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") "
Jul 20 03:27:25.408890 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.408762    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25076512-833b-4fd6-8367-e6ecc6aec650-tls-certs\") pod \"25076512-833b-4fd6-8367-e6ecc6aec650\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") "
Jul 20 03:27:25.408890 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.408777    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-home\") pod \"25076512-833b-4fd6-8367-e6ecc6aec650\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") "
Jul 20 03:27:25.408890 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.408848    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xswth\" (UniqueName: \"kubernetes.io/projected/25076512-833b-4fd6-8367-e6ecc6aec650-kube-api-access-xswth\") pod \"25076512-833b-4fd6-8367-e6ecc6aec650\" (UID: \"25076512-833b-4fd6-8367-e6ecc6aec650\") "
Jul 20 03:27:25.409160 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.408981    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-model-cache" (OuterVolumeSpecName: "model-cache") pod "25076512-833b-4fd6-8367-e6ecc6aec650" (UID: "25076512-833b-4fd6-8367-e6ecc6aec650"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:27:25.409160 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.409020    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "25076512-833b-4fd6-8367-e6ecc6aec650" (UID: "25076512-833b-4fd6-8367-e6ecc6aec650"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:27:25.409160 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.409103    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-home" (OuterVolumeSpecName: "home") pod "25076512-833b-4fd6-8367-e6ecc6aec650" (UID: "25076512-833b-4fd6-8367-e6ecc6aec650"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:27:25.409160 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.409114    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-model-cache\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:25.411026 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.410998    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-dshm" (OuterVolumeSpecName: "dshm") pod "25076512-833b-4fd6-8367-e6ecc6aec650" (UID: "25076512-833b-4fd6-8367-e6ecc6aec650"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:27:25.411026 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.411010    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25076512-833b-4fd6-8367-e6ecc6aec650-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "25076512-833b-4fd6-8367-e6ecc6aec650" (UID: "25076512-833b-4fd6-8367-e6ecc6aec650"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 03:27:25.411200 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.411111    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25076512-833b-4fd6-8367-e6ecc6aec650-kube-api-access-xswth" (OuterVolumeSpecName: "kube-api-access-xswth") pod "25076512-833b-4fd6-8367-e6ecc6aec650" (UID: "25076512-833b-4fd6-8367-e6ecc6aec650"). InnerVolumeSpecName "kube-api-access-xswth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:27:25.510287 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.510236    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-tmp-dir\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:25.510287 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.510280    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25076512-833b-4fd6-8367-e6ecc6aec650-tls-certs\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:25.510287 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.510290    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-home\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:25.510287 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.510298    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xswth\" (UniqueName: \"kubernetes.io/projected/25076512-833b-4fd6-8367-e6ecc6aec650-kube-api-access-xswth\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:25.510287 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.510306    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25076512-833b-4fd6-8367-e6ecc6aec650-dshm\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:25.568465 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.568370    2584 generic.go:356] "Generic (PLEG): container finished" podID="25076512-833b-4fd6-8367-e6ecc6aec650" containerID="fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d" exitCode=0
Jul 20 03:27:25.568465 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.568419    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"
Jul 20 03:27:25.568737 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.568460    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj" event={"ID":"25076512-833b-4fd6-8367-e6ecc6aec650","Type":"ContainerDied","Data":"fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d"}
Jul 20 03:27:25.568737 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.568508    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj" event={"ID":"25076512-833b-4fd6-8367-e6ecc6aec650","Type":"ContainerDied","Data":"c449f38c8c39a9c1a04706d0b57fff8fafdcd3939a949687ae259145e0aa9bcf"}
Jul 20 03:27:25.568737 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.568529    2584 scope.go:117] "RemoveContainer" containerID="fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d"
Jul 20 03:27:25.577561 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.577545    2584 scope.go:117] "RemoveContainer" containerID="fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d"
Jul 20 03:27:25.577827 ip-10-0-140-191 kubenswrapper[2584]: E0720 03:27:25.577810    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d\": container with ID starting with fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d not found: ID does not exist" containerID="fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d"
Jul 20 03:27:25.577910 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.577840    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d"} err="failed to get container status \"fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d\": rpc error: code = NotFound desc = could not find container \"fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d\": container with ID starting with fa585c1b07bf5b0a4d029f11f056a11a86a84fdb697ea56c46ab0c5569c1b75d not found: ID does not exist"
Jul 20 03:27:25.588522 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.588502    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"]
Jul 20 03:27:25.592098 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.592079    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-9fe24f/test-model-9fe24f-kserve-798d6655d9-5ldtj"]
Jul 20 03:27:25.658020 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:25.657994    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:26.279264 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:26.279235    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25076512-833b-4fd6-8367-e6ecc6aec650" path="/var/lib/kubelet/pods/25076512-833b-4fd6-8367-e6ecc6aec650/volumes"
Jul 20 03:27:26.279673 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:26.279624    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57bc5baf-04c8-40ed-aa42-6166bd2a9353" path="/var/lib/kubelet/pods/57bc5baf-04c8-40ed-aa42-6166bd2a9353/volumes"
Jul 20 03:27:31.427449 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:31.427410    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:31.481014 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:31.480986    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:31.692338 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:31.692261    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:31.938563 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:31.938527    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:32.068504 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.068471    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"]
Jul 20 03:27:32.068863 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.068851    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25076512-833b-4fd6-8367-e6ecc6aec650" containerName="main"
Jul 20 03:27:32.068917 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.068865    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="25076512-833b-4fd6-8367-e6ecc6aec650" containerName="main"
Jul 20 03:27:32.068917 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.068887    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57bc5baf-04c8-40ed-aa42-6166bd2a9353" containerName="main"
Jul 20 03:27:32.068917 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.068893    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="57bc5baf-04c8-40ed-aa42-6166bd2a9353" containerName="main"
Jul 20 03:27:32.069008 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.068951    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="25076512-833b-4fd6-8367-e6ecc6aec650" containerName="main"
Jul 20 03:27:32.069008 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.068961    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="57bc5baf-04c8-40ed-aa42-6166bd2a9353" containerName="main"
Jul 20 03:27:32.071935 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.071918    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"
Jul 20 03:27:32.073909 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.073891    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hlzh6\""
Jul 20 03:27:32.074032 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.073950    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 03:27:32.078109 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.078086    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"]
Jul 20 03:27:32.264912 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.264876    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4efcec-6769-4b17-85c8-f20b1d6987cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7\" (UID: \"5b4efcec-6769-4b17-85c8-f20b1d6987cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"
Jul 20 03:27:32.365786 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.365704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4efcec-6769-4b17-85c8-f20b1d6987cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7\" (UID: \"5b4efcec-6769-4b17-85c8-f20b1d6987cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"
Jul 20 03:27:32.366286 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.366267    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4efcec-6769-4b17-85c8-f20b1d6987cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7\" (UID: \"5b4efcec-6769-4b17-85c8-f20b1d6987cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"
Jul 20 03:27:32.382689 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.382664    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"
Jul 20 03:27:32.513085 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.513056    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"]
Jul 20 03:27:32.515632 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:27:32.515605    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4efcec_6769_4b17_85c8_f20b1d6987cc.slice/crio-14cba7a4101e9cba5cf60cb0ffa0a015313de18f5cd7ace66f9da8775932ed2e WatchSource:0}: Error finding container 14cba7a4101e9cba5cf60cb0ffa0a015313de18f5cd7ace66f9da8775932ed2e: Status 404 returned error can't find the container with id 14cba7a4101e9cba5cf60cb0ffa0a015313de18f5cd7ace66f9da8775932ed2e
Jul 20 03:27:32.517565 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.517549    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 03:27:32.604197 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.604165    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7" event={"ID":"5b4efcec-6769-4b17-85c8-f20b1d6987cc","Type":"ContainerStarted","Data":"14cba7a4101e9cba5cf60cb0ffa0a015313de18f5cd7ace66f9da8775932ed2e"}
Jul 20 03:27:32.664899 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.664820    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:32.765963 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:32.765929    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:35.619178 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:35.619088    2584 generic.go:356] "Generic (PLEG): container finished" podID="5b4efcec-6769-4b17-85c8-f20b1d6987cc" containerID="5ebf71f520cf36731743059dfd8ee39e47a0f45dbcb6905efcb0212c9db36fe2" exitCode=0
Jul 20 03:27:35.619178 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:35.619157    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7" event={"ID":"5b4efcec-6769-4b17-85c8-f20b1d6987cc","Type":"ContainerDied","Data":"5ebf71f520cf36731743059dfd8ee39e47a0f45dbcb6905efcb0212c9db36fe2"}
Jul 20 03:27:36.753183 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:36.753158    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"
Jul 20 03:27:36.800819 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:36.800793    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4efcec-6769-4b17-85c8-f20b1d6987cc-maas-api-service-ca\") pod \"5b4efcec-6769-4b17-85c8-f20b1d6987cc\" (UID: \"5b4efcec-6769-4b17-85c8-f20b1d6987cc\") "
Jul 20 03:27:36.801164 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:36.801139    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b4efcec-6769-4b17-85c8-f20b1d6987cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5b4efcec-6769-4b17-85c8-f20b1d6987cc" (UID: "5b4efcec-6769-4b17-85c8-f20b1d6987cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 03:27:36.902347 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:36.902264    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4efcec-6769-4b17-85c8-f20b1d6987cc-maas-api-service-ca\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:27:37.630531 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:37.630501    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7" event={"ID":"5b4efcec-6769-4b17-85c8-f20b1d6987cc","Type":"ContainerDied","Data":"14cba7a4101e9cba5cf60cb0ffa0a015313de18f5cd7ace66f9da8775932ed2e"}
Jul 20 03:27:37.630730 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:37.630547    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14cba7a4101e9cba5cf60cb0ffa0a015313de18f5cd7ace66f9da8775932ed2e"
Jul 20 03:27:37.630730 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:37.630506    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"
Jul 20 03:27:42.631567 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:42.631534    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:47.188505 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:47.188468    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:47.193379 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:47.193323    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"]
Jul 20 03:27:47.195336 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:47.195316    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9fe24f-rs6n7"]
Jul 20 03:27:47.596060 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:47.596018    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:48.278894 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:48.278862    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b4efcec-6769-4b17-85c8-f20b1d6987cc" path="/var/lib/kubelet/pods/5b4efcec-6769-4b17-85c8-f20b1d6987cc/volumes"
Jul 20 03:27:53.331742 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:53.331707    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:54.313862 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:54.313828    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:54.521571 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:54.521532    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:54.613503 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:54.613429    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:57.707111 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:57.707045    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:57.798567 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:57.798537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:57.928118 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:57.928084    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:58.311480 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:58.311451    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:58.481564 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:58.481532    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:27:58.585564 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:27:58.585480    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:02.217760 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:02.217725    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:02.673774 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:02.673740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:02.990756 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:02.990671    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:03.093183 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:03.093149    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:05.331299 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:05.331262    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:05.738772 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:05.738690    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:05.839539 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:05.839506    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:05.962869 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:05.962825    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:06.505070 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:06.505036    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:06.605613 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:06.605577    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:06.804911 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:06.804879    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:10.229985 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:10.229947    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:18.792350 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:18.792273    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:18.894184 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:18.894146    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:27.343512 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:27.343482    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:27.446624 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:27.446589    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:28.904928 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:28.904895    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:29.004527 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:29.004499    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:34.166840 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:34.166806    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:38.382724 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:38.382687    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:38.747153 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:38.747059    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:44.369709 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:44.369669    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:44.463404 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:44.463372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:44.628648 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:44.628565    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:44.860488 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:44.860456    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:45.655223 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:45.655192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:45.746847 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:45.746814    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:49.334462 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:49.334427    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:54.885887 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:54.885850    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:28:54.937179 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:28:54.937146    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:00.429097 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:00.429061    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:04.047020 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:04.046982    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:04.149498 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:04.149460    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:05.049583 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:05.049554    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:05.440483 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:05.440393    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:11.285327 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:11.285288    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:11.344609 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:11.344576    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:11.632528 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:11.632457    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:11.837321 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:11.837286    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:12.166266 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:12.166231    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:12.486144 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:12.486061    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:12.736088 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:12.736054    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:15.135448 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:15.135411    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:15.236159 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:15.236121    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:15.303702 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:15.303667    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:15.680781 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:15.680747    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:15.899187 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:15.899150    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:16.000144 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:16.000060    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:19.688848 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:19.688789    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:19.991443 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:19.991349    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:20.295098 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:20.295064    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:20.712685 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:20.712577    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:23.160585 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:23.160537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:23.239898 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:23.239854    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:23.302981 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:23.302948    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:23.603222 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:23.603192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:23.830923 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:23.830894    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:23.930714 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:23.930595    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:27.673288 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:27.673240    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:36.778216 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:36.778172    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:36.879252 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:36.879203    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:39.549697 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.549661    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"]
Jul 20 03:29:39.550163 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.550004    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b4efcec-6769-4b17-85c8-f20b1d6987cc" containerName="revoke-keys"
Jul 20 03:29:39.550163 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.550014    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b4efcec-6769-4b17-85c8-f20b1d6987cc" containerName="revoke-keys"
Jul 20 03:29:39.550163 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.550091    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b4efcec-6769-4b17-85c8-f20b1d6987cc" containerName="revoke-keys"
Jul 20 03:29:39.553187 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.553162    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.555356 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.555330    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-496193\"/\"kube-root-ca.crt\""
Jul 20 03:29:39.556002 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.555974    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-496193\"/\"openshift-service-ca.crt\""
Jul 20 03:29:39.556113 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.556005    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-496193\"/\"auth-test-model-496193-kserve-self-signed-certs\""
Jul 20 03:29:39.556113 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.556010    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-496193\"/\"default-dockercfg-rmlzv\""
Jul 20 03:29:39.562188 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.562164    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"]
Jul 20 03:29:39.584480 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.582578    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:39.633687 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.633607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-dshm\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.633687 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.633695    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlb28\" (UniqueName: \"kubernetes.io/projected/9759b28d-aaee-49be-8153-d4d56915d633-kube-api-access-jlb28\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.633896 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.633740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9759b28d-aaee-49be-8153-d4d56915d633-tls-certs\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.633896 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.633809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-tmp-dir\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.633896 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.633843    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-home\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.633896 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.633860    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-model-cache\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.734734 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.734682    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-tmp-dir\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.734734 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.734735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-home\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.734956 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.734755    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-model-cache\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.734956 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.734829    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-dshm\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.734956 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.734854    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlb28\" (UniqueName: \"kubernetes.io/projected/9759b28d-aaee-49be-8153-d4d56915d633-kube-api-access-jlb28\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.734956 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.734906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9759b28d-aaee-49be-8153-d4d56915d633-tls-certs\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.735176 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.735150    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-tmp-dir\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.735241 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.735192    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-home\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.735287 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.735230    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-model-cache\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.737255 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.737226    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-dshm\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.737438 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.737424    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9759b28d-aaee-49be-8153-d4d56915d633-tls-certs\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.742551 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.742530    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlb28\" (UniqueName: \"kubernetes.io/projected/9759b28d-aaee-49be-8153-d4d56915d633-kube-api-access-jlb28\") pod \"auth-test-model-496193-kserve-66b474c47-5h5jc\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") " pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.863118 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.863016    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:39.994370 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:39.994345    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"]
Jul 20 03:29:39.997019 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:29:39.996992    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9759b28d_aaee_49be_8153_d4d56915d633.slice/crio-e3cde6e826293a1a427f401071aff269d61bcabd99dc0aef6b0f1b01ee2ff10f WatchSource:0}: Error finding container e3cde6e826293a1a427f401071aff269d61bcabd99dc0aef6b0f1b01ee2ff10f: Status 404 returned error can't find the container with id e3cde6e826293a1a427f401071aff269d61bcabd99dc0aef6b0f1b01ee2ff10f
Jul 20 03:29:40.202197 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:40.202107    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc" event={"ID":"9759b28d-aaee-49be-8153-d4d56915d633","Type":"ContainerStarted","Data":"9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248"}
Jul 20 03:29:40.202197 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:40.202149    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc" event={"ID":"9759b28d-aaee-49be-8153-d4d56915d633","Type":"ContainerStarted","Data":"e3cde6e826293a1a427f401071aff269d61bcabd99dc0aef6b0f1b01ee2ff10f"}
Jul 20 03:29:40.218699 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:40.218610    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc" podStartSLOduration=1.2185889 podStartE2EDuration="1.2185889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 03:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 03:29:40.217832831 +0000 UTC m=+2688.444601557" watchObservedRunningTime="2026-07-20 03:29:40.2185889 +0000 UTC m=+2688.445357602"
Jul 20 03:29:44.589389 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:44.589301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:44.689767 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:44.689737    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:29:49.863234 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:49.863185    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:49.863234 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:49.863239    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:49.875797 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:49.875770    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:50.259756 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:50.259668    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:29:56.468005 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:56.467896    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:29:56.479044 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:29:56.474932    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:30:07.458521 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:30:07.458487    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:31:58.760951 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:31:58.760920    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:32:09.385339 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:09.385300    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"]
Jul 20 03:32:09.412793 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:09.412750    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:32:10.334547 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:10.334513    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:32:24.411888 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.411843    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc" podUID="9759b28d-aaee-49be-8153-d4d56915d633" containerName="main" containerID="cri-o://9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248" gracePeriod=45
Jul 20 03:32:24.668158 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.668086    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:32:24.827016 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.826971    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-model-cache\") pod \"9759b28d-aaee-49be-8153-d4d56915d633\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") "
Jul 20 03:32:24.827016 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.827019    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlb28\" (UniqueName: \"kubernetes.io/projected/9759b28d-aaee-49be-8153-d4d56915d633-kube-api-access-jlb28\") pod \"9759b28d-aaee-49be-8153-d4d56915d633\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") "
Jul 20 03:32:24.827301 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.827078    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-home\") pod \"9759b28d-aaee-49be-8153-d4d56915d633\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") "
Jul 20 03:32:24.827301 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.827136    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-tmp-dir\") pod \"9759b28d-aaee-49be-8153-d4d56915d633\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") "
Jul 20 03:32:24.827301 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.827184    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9759b28d-aaee-49be-8153-d4d56915d633-tls-certs\") pod \"9759b28d-aaee-49be-8153-d4d56915d633\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") "
Jul 20 03:32:24.827301 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.827228    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-dshm\") pod \"9759b28d-aaee-49be-8153-d4d56915d633\" (UID: \"9759b28d-aaee-49be-8153-d4d56915d633\") "
Jul 20 03:32:24.827301 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.827289    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-model-cache" (OuterVolumeSpecName: "model-cache") pod "9759b28d-aaee-49be-8153-d4d56915d633" (UID: "9759b28d-aaee-49be-8153-d4d56915d633"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:32:24.827559 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.827471    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-home" (OuterVolumeSpecName: "home") pod "9759b28d-aaee-49be-8153-d4d56915d633" (UID: "9759b28d-aaee-49be-8153-d4d56915d633"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:32:24.827559 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.827480    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9759b28d-aaee-49be-8153-d4d56915d633" (UID: "9759b28d-aaee-49be-8153-d4d56915d633"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:32:24.827559 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.827489    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-model-cache\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:32:24.829440 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.829412    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9759b28d-aaee-49be-8153-d4d56915d633-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9759b28d-aaee-49be-8153-d4d56915d633" (UID: "9759b28d-aaee-49be-8153-d4d56915d633"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 03:32:24.829440 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.829426    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-dshm" (OuterVolumeSpecName: "dshm") pod "9759b28d-aaee-49be-8153-d4d56915d633" (UID: "9759b28d-aaee-49be-8153-d4d56915d633"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:32:24.829587 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.829459    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9759b28d-aaee-49be-8153-d4d56915d633-kube-api-access-jlb28" (OuterVolumeSpecName: "kube-api-access-jlb28") pod "9759b28d-aaee-49be-8153-d4d56915d633" (UID: "9759b28d-aaee-49be-8153-d4d56915d633"). InnerVolumeSpecName "kube-api-access-jlb28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:32:24.928035 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.927946    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-dshm\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:32:24.928035 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.927983    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlb28\" (UniqueName: \"kubernetes.io/projected/9759b28d-aaee-49be-8153-d4d56915d633-kube-api-access-jlb28\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:32:24.928035 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.927995    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-home\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:32:24.928035 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.928003    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9759b28d-aaee-49be-8153-d4d56915d633-tmp-dir\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:32:24.928035 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.928016    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9759b28d-aaee-49be-8153-d4d56915d633-tls-certs\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:32:24.966452 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.966418    2584 generic.go:356] "Generic (PLEG): container finished" podID="9759b28d-aaee-49be-8153-d4d56915d633" containerID="9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248" exitCode=0
Jul 20 03:32:24.966657 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.966469    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"
Jul 20 03:32:24.966657 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.966481    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc" event={"ID":"9759b28d-aaee-49be-8153-d4d56915d633","Type":"ContainerDied","Data":"9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248"}
Jul 20 03:32:24.966657 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.966513    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc" event={"ID":"9759b28d-aaee-49be-8153-d4d56915d633","Type":"ContainerDied","Data":"e3cde6e826293a1a427f401071aff269d61bcabd99dc0aef6b0f1b01ee2ff10f"}
Jul 20 03:32:24.966657 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.966531    2584 scope.go:117] "RemoveContainer" containerID="9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248"
Jul 20 03:32:24.975468 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.975445    2584 scope.go:117] "RemoveContainer" containerID="9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248"
Jul 20 03:32:24.975727 ip-10-0-140-191 kubenswrapper[2584]: E0720 03:32:24.975707    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248\": container with ID starting with 9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248 not found: ID does not exist" containerID="9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248"
Jul 20 03:32:24.975787 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.975736    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248"} err="failed to get container status \"9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248\": rpc error: code = NotFound desc = could not find container \"9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248\": container with ID starting with 9d8a89cbffe52f7a4d982bf95097d43eb97e8b59a3d401fd0d3bbfe196a37248 not found: ID does not exist"
Jul 20 03:32:24.986585 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.986556    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"]
Jul 20 03:32:24.990122 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:24.990094    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-496193/auth-test-model-496193-kserve-66b474c47-5h5jc"]
Jul 20 03:32:26.278854 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:26.278826    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9759b28d-aaee-49be-8153-d4d56915d633" path="/var/lib/kubelet/pods/9759b28d-aaee-49be-8153-d4d56915d633/volumes"
Jul 20 03:32:31.838243 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.838208    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"]
Jul 20 03:32:31.838679 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.838541    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9759b28d-aaee-49be-8153-d4d56915d633" containerName="main"
Jul 20 03:32:31.838679 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.838551    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9759b28d-aaee-49be-8153-d4d56915d633" containerName="main"
Jul 20 03:32:31.838679 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.838619    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9759b28d-aaee-49be-8153-d4d56915d633" containerName="main"
Jul 20 03:32:31.841327 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.841310    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:31.843680 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.843655    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-496193\"/\"openshift-service-ca.crt\""
Jul 20 03:32:31.843680 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.843670    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-496193\"/\"default-dockercfg-rmlzv\""
Jul 20 03:32:31.843855 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.843695    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-496193\"/\"sub-test-model-496193-kserve-self-signed-certs\""
Jul 20 03:32:31.843855 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.843740    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-496193\"/\"kube-root-ca.crt\""
Jul 20 03:32:31.849600 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.849573    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"]
Jul 20 03:32:31.992238 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.992197    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9qsm\" (UniqueName: \"kubernetes.io/projected/31c5ec1c-98de-46df-b742-7827887409b9-kube-api-access-l9qsm\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:31.992238 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.992244    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-model-cache\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:31.992466 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.992275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-home\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:31.992466 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.992333    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-dshm\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:31.992466 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.992353    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c5ec1c-98de-46df-b742-7827887409b9-tls-certs\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:31.992466 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.992370    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-tmp-dir\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:31.997625 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:31.997596    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:32:32.093178 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.093083    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-home\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.093178 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.093153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-dshm\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.093178 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.093180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c5ec1c-98de-46df-b742-7827887409b9-tls-certs\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.093468 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.093198    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-tmp-dir\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.093468 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.093218    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9qsm\" (UniqueName: \"kubernetes.io/projected/31c5ec1c-98de-46df-b742-7827887409b9-kube-api-access-l9qsm\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.093468 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.093244    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-model-cache\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.093667 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.093621    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-model-cache\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.093726 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.093690    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-home\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.093765 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.093729    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-tmp-dir\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.095582 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.095550    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-dshm\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.095900 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.095883    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c5ec1c-98de-46df-b742-7827887409b9-tls-certs\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.101364 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.101338    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9qsm\" (UniqueName: \"kubernetes.io/projected/31c5ec1c-98de-46df-b742-7827887409b9-kube-api-access-l9qsm\") pod \"sub-test-model-496193-kserve-7454d7dfd7-9sl9k\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") " pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.151618 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.151579    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:32.286015 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:32.285985    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"]
Jul 20 03:32:32.289170 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:32:32.289135    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31c5ec1c_98de_46df_b742_7827887409b9.slice/crio-933992e9d75dd71e2170b94e431364bcf60261635312bf9b3902b673b02311e6 WatchSource:0}: Error finding container 933992e9d75dd71e2170b94e431364bcf60261635312bf9b3902b673b02311e6: Status 404 returned error can't find the container with id 933992e9d75dd71e2170b94e431364bcf60261635312bf9b3902b673b02311e6
Jul 20 03:32:33.007283 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:33.007242    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k" event={"ID":"31c5ec1c-98de-46df-b742-7827887409b9","Type":"ContainerStarted","Data":"dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470"}
Jul 20 03:32:33.007697 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:33.007293    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k" event={"ID":"31c5ec1c-98de-46df-b742-7827887409b9","Type":"ContainerStarted","Data":"933992e9d75dd71e2170b94e431364bcf60261635312bf9b3902b673b02311e6"}
Jul 20 03:32:33.036403 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:33.036354    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k" podStartSLOduration=2.036330999 podStartE2EDuration="2.036330999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 03:32:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 03:32:33.035559336 +0000 UTC m=+2861.262328047" watchObservedRunningTime="2026-07-20 03:32:33.036330999 +0000 UTC m=+2861.263099700"
Jul 20 03:32:34.106126 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:34.106078    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:32:42.152582 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:42.152528    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:42.152582 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:42.152593    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:42.165090 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:42.165057    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:32:43.066237 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:32:43.066197    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:33:04.238045 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.238006    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"]
Jul 20 03:33:04.241139 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.241114    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.243188 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.243163    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c1951c\"/\"kube-root-ca.crt\""
Jul 20 03:33:04.243323 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.243211    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c1951c\"/\"default-dockercfg-46jhr\""
Jul 20 03:33:04.243323 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.243238    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c1951c\"/\"openshift-service-ca.crt\""
Jul 20 03:33:04.243755 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.243739    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c1951c\"/\"sub-test-model-c1951c-kserve-self-signed-certs\""
Jul 20 03:33:04.252918 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.252896    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"]
Jul 20 03:33:04.329447 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.329409    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:33:04.381849 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.381812    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmxtc\" (UniqueName: \"kubernetes.io/projected/c643392f-b5a5-450a-a320-5e8b74ce9d46-kube-api-access-gmxtc\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.382048 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.381862    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-tmp-dir\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.382048 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.381886    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c643392f-b5a5-450a-a320-5e8b74ce9d46-tls-certs\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.382048 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.381967    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-home\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.382048 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.381999    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-model-cache\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.382048 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.382034    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-dshm\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.482908 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.482866    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmxtc\" (UniqueName: \"kubernetes.io/projected/c643392f-b5a5-450a-a320-5e8b74ce9d46-kube-api-access-gmxtc\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.483134 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.482923    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-tmp-dir\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.483134 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.483038    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c643392f-b5a5-450a-a320-5e8b74ce9d46-tls-certs\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.483134 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.483098    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-home\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.483134 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.483124    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-model-cache\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.483335 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.483170    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-dshm\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.483455 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.483437    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-tmp-dir\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.483507 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.483486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-home\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.483563 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.483536    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-model-cache\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.485699 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.485612    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-dshm\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.485831 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.485756    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c643392f-b5a5-450a-a320-5e8b74ce9d46-tls-certs\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.491448 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.491254    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmxtc\" (UniqueName: \"kubernetes.io/projected/c643392f-b5a5-450a-a320-5e8b74ce9d46-kube-api-access-gmxtc\") pod \"sub-test-model-c1951c-kserve-dfddd979f-75z72\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") " pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.549736 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.549703    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:04.687846 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:04.687819    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"]
Jul 20 03:33:04.690366 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:33:04.690287    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc643392f_b5a5_450a_a320_5e8b74ce9d46.slice/crio-5b3556d199ea788464203991a118bc5f76fda33b7f384771df381fed8863c0cb WatchSource:0}: Error finding container 5b3556d199ea788464203991a118bc5f76fda33b7f384771df381fed8863c0cb: Status 404 returned error can't find the container with id 5b3556d199ea788464203991a118bc5f76fda33b7f384771df381fed8863c0cb
Jul 20 03:33:05.162247 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:05.162208    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72" event={"ID":"c643392f-b5a5-450a-a320-5e8b74ce9d46","Type":"ContainerStarted","Data":"c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc"}
Jul 20 03:33:05.162247 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:05.162255    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72" event={"ID":"c643392f-b5a5-450a-a320-5e8b74ce9d46","Type":"ContainerStarted","Data":"5b3556d199ea788464203991a118bc5f76fda33b7f384771df381fed8863c0cb"}
Jul 20 03:33:05.179304 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:05.179235    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72" podStartSLOduration=1.179212 podStartE2EDuration="1.179212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 03:33:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 03:33:05.178323334 +0000 UTC m=+2893.405092033" watchObservedRunningTime="2026-07-20 03:33:05.179212 +0000 UTC m=+2893.405980702"
Jul 20 03:33:14.550784 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:14.550748    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:14.550784 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:14.550795    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:14.563360 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:14.563330    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:15.221222 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:15.221181    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:33:52.503117 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:52.503088    2584 scope.go:117] "RemoveContainer" containerID="5ebf71f520cf36731743059dfd8ee39e47a0f45dbcb6905efcb0212c9db36fe2"
Jul 20 03:33:53.321061 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:53.321026    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"]
Jul 20 03:33:53.342718 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:53.342694    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:33:54.171274 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:54.171243    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"]
Jul 20 03:33:54.189416 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:33:54.189348    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:34:04.793271 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:04.793235    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:34:04.892513 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:04.892483    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:34:05.064765 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:05.064681    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:34:08.341233 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.341198    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k" podUID="31c5ec1c-98de-46df-b742-7827887409b9" containerName="main" containerID="cri-o://dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470" gracePeriod=45
Jul 20 03:34:08.598360 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.598302    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:34:08.744981 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.744949    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-home\") pod \"31c5ec1c-98de-46df-b742-7827887409b9\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") "
Jul 20 03:34:08.745155 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745013    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-model-cache\") pod \"31c5ec1c-98de-46df-b742-7827887409b9\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") "
Jul 20 03:34:08.745155 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745077    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9qsm\" (UniqueName: \"kubernetes.io/projected/31c5ec1c-98de-46df-b742-7827887409b9-kube-api-access-l9qsm\") pod \"31c5ec1c-98de-46df-b742-7827887409b9\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") "
Jul 20 03:34:08.745155 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745100    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c5ec1c-98de-46df-b742-7827887409b9-tls-certs\") pod \"31c5ec1c-98de-46df-b742-7827887409b9\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") "
Jul 20 03:34:08.745155 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745150    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-dshm\") pod \"31c5ec1c-98de-46df-b742-7827887409b9\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") "
Jul 20 03:34:08.745381 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745176    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-tmp-dir\") pod \"31c5ec1c-98de-46df-b742-7827887409b9\" (UID: \"31c5ec1c-98de-46df-b742-7827887409b9\") "
Jul 20 03:34:08.745381 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745231    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-home" (OuterVolumeSpecName: "home") pod "31c5ec1c-98de-46df-b742-7827887409b9" (UID: "31c5ec1c-98de-46df-b742-7827887409b9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:34:08.745381 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745326    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-model-cache" (OuterVolumeSpecName: "model-cache") pod "31c5ec1c-98de-46df-b742-7827887409b9" (UID: "31c5ec1c-98de-46df-b742-7827887409b9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:34:08.745535 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745459    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-model-cache\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:08.745535 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745475    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-home\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:08.745535 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.745489    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "31c5ec1c-98de-46df-b742-7827887409b9" (UID: "31c5ec1c-98de-46df-b742-7827887409b9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:34:08.747252 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.747230    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c5ec1c-98de-46df-b742-7827887409b9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "31c5ec1c-98de-46df-b742-7827887409b9" (UID: "31c5ec1c-98de-46df-b742-7827887409b9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 03:34:08.747363 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.747259    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-dshm" (OuterVolumeSpecName: "dshm") pod "31c5ec1c-98de-46df-b742-7827887409b9" (UID: "31c5ec1c-98de-46df-b742-7827887409b9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:34:08.747363 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.747266    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c5ec1c-98de-46df-b742-7827887409b9-kube-api-access-l9qsm" (OuterVolumeSpecName: "kube-api-access-l9qsm") pod "31c5ec1c-98de-46df-b742-7827887409b9" (UID: "31c5ec1c-98de-46df-b742-7827887409b9"). InnerVolumeSpecName "kube-api-access-l9qsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:34:08.846881 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.846834    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9qsm\" (UniqueName: \"kubernetes.io/projected/31c5ec1c-98de-46df-b742-7827887409b9-kube-api-access-l9qsm\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:08.846881 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.846878    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c5ec1c-98de-46df-b742-7827887409b9-tls-certs\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:08.846881 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.846888    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-dshm\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:08.846881 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:08.846897    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c5ec1c-98de-46df-b742-7827887409b9-tmp-dir\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:09.191652 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.191599    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72" podUID="c643392f-b5a5-450a-a320-5e8b74ce9d46" containerName="main" containerID="cri-o://c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc" gracePeriod=45
Jul 20 03:34:09.445995 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.445934    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:34:09.460126 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.460099    2584 generic.go:356] "Generic (PLEG): container finished" podID="31c5ec1c-98de-46df-b742-7827887409b9" containerID="dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470" exitCode=0
Jul 20 03:34:09.460263 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.460134    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"
Jul 20 03:34:09.460263 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.460188    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k" event={"ID":"31c5ec1c-98de-46df-b742-7827887409b9","Type":"ContainerDied","Data":"dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470"}
Jul 20 03:34:09.460263 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.460224    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k" event={"ID":"31c5ec1c-98de-46df-b742-7827887409b9","Type":"ContainerDied","Data":"933992e9d75dd71e2170b94e431364bcf60261635312bf9b3902b673b02311e6"}
Jul 20 03:34:09.460263 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.460244    2584 scope.go:117] "RemoveContainer" containerID="dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470"
Jul 20 03:34:09.461753 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.461732    2584 generic.go:356] "Generic (PLEG): container finished" podID="c643392f-b5a5-450a-a320-5e8b74ce9d46" containerID="c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc" exitCode=0
Jul 20 03:34:09.461874 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.461786    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72" event={"ID":"c643392f-b5a5-450a-a320-5e8b74ce9d46","Type":"ContainerDied","Data":"c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc"}
Jul 20 03:34:09.461874 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.461814    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72" event={"ID":"c643392f-b5a5-450a-a320-5e8b74ce9d46","Type":"ContainerDied","Data":"5b3556d199ea788464203991a118bc5f76fda33b7f384771df381fed8863c0cb"}
Jul 20 03:34:09.461874 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.461788    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"
Jul 20 03:34:09.470185 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.470150    2584 scope.go:117] "RemoveContainer" containerID="dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470"
Jul 20 03:34:09.470457 ip-10-0-140-191 kubenswrapper[2584]: E0720 03:34:09.470433    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470\": container with ID starting with dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470 not found: ID does not exist" containerID="dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470"
Jul 20 03:34:09.470562 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.470463    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470"} err="failed to get container status \"dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470\": rpc error: code = NotFound desc = could not find container \"dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470\": container with ID starting with dcfa521c00ab1646f93270634bdb126617370fa8cbfee7437652905114735470 not found: ID does not exist"
Jul 20 03:34:09.470562 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.470481    2584 scope.go:117] "RemoveContainer" containerID="c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc"
Jul 20 03:34:09.480009 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.479929    2584 scope.go:117] "RemoveContainer" containerID="c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc"
Jul 20 03:34:09.480332 ip-10-0-140-191 kubenswrapper[2584]: E0720 03:34:09.480268    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc\": container with ID starting with c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc not found: ID does not exist" containerID="c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc"
Jul 20 03:34:09.480332 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.480305    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc"} err="failed to get container status \"c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc\": rpc error: code = NotFound desc = could not find container \"c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc\": container with ID starting with c45c4f561b47bd552f85cb99fcdf8984d716ce2c7543dd85a295acedc76be1fc not found: ID does not exist"
Jul 20 03:34:09.481852 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.481834    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"]
Jul 20 03:34:09.487604 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.487586    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-496193/sub-test-model-496193-kserve-7454d7dfd7-9sl9k"]
Jul 20 03:34:09.553919 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.553895    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmxtc\" (UniqueName: \"kubernetes.io/projected/c643392f-b5a5-450a-a320-5e8b74ce9d46-kube-api-access-gmxtc\") pod \"c643392f-b5a5-450a-a320-5e8b74ce9d46\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") "
Jul 20 03:34:09.554049 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.553926    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-home\") pod \"c643392f-b5a5-450a-a320-5e8b74ce9d46\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") "
Jul 20 03:34:09.554049 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.553973    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-tmp-dir\") pod \"c643392f-b5a5-450a-a320-5e8b74ce9d46\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") "
Jul 20 03:34:09.554049 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.554015    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c643392f-b5a5-450a-a320-5e8b74ce9d46-tls-certs\") pod \"c643392f-b5a5-450a-a320-5e8b74ce9d46\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") "
Jul 20 03:34:09.554204 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.554059    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-model-cache\") pod \"c643392f-b5a5-450a-a320-5e8b74ce9d46\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") "
Jul 20 03:34:09.554204 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.554087    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-dshm\") pod \"c643392f-b5a5-450a-a320-5e8b74ce9d46\" (UID: \"c643392f-b5a5-450a-a320-5e8b74ce9d46\") "
Jul 20 03:34:09.554204 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.554181    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-home" (OuterVolumeSpecName: "home") pod "c643392f-b5a5-450a-a320-5e8b74ce9d46" (UID: "c643392f-b5a5-450a-a320-5e8b74ce9d46"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:34:09.554360 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.554283    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c643392f-b5a5-450a-a320-5e8b74ce9d46" (UID: "c643392f-b5a5-450a-a320-5e8b74ce9d46"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:34:09.554360 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.554286    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-model-cache" (OuterVolumeSpecName: "model-cache") pod "c643392f-b5a5-450a-a320-5e8b74ce9d46" (UID: "c643392f-b5a5-450a-a320-5e8b74ce9d46"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:34:09.554457 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.554364    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-model-cache\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:09.554457 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.554378    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-home\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:09.554457 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.554390    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-tmp-dir\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:09.556185 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.556158    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-dshm" (OuterVolumeSpecName: "dshm") pod "c643392f-b5a5-450a-a320-5e8b74ce9d46" (UID: "c643392f-b5a5-450a-a320-5e8b74ce9d46"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:34:09.556271 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.556241    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c643392f-b5a5-450a-a320-5e8b74ce9d46-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c643392f-b5a5-450a-a320-5e8b74ce9d46" (UID: "c643392f-b5a5-450a-a320-5e8b74ce9d46"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 03:34:09.556271 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.556244    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c643392f-b5a5-450a-a320-5e8b74ce9d46-kube-api-access-gmxtc" (OuterVolumeSpecName: "kube-api-access-gmxtc") pod "c643392f-b5a5-450a-a320-5e8b74ce9d46" (UID: "c643392f-b5a5-450a-a320-5e8b74ce9d46"). InnerVolumeSpecName "kube-api-access-gmxtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:34:09.655135 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.655099    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c643392f-b5a5-450a-a320-5e8b74ce9d46-tls-certs\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:09.655135 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.655127    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c643392f-b5a5-450a-a320-5e8b74ce9d46-dshm\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:09.655135 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.655136    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmxtc\" (UniqueName: \"kubernetes.io/projected/c643392f-b5a5-450a-a320-5e8b74ce9d46-kube-api-access-gmxtc\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:34:09.782629 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.782599    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"]
Jul 20 03:34:09.785785 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:09.785760    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/sub-test-model-c1951c-kserve-dfddd979f-75z72"]
Jul 20 03:34:10.279761 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:10.279728    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31c5ec1c-98de-46df-b742-7827887409b9" path="/var/lib/kubelet/pods/31c5ec1c-98de-46df-b742-7827887409b9/volumes"
Jul 20 03:34:10.280115 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:10.280102    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c643392f-b5a5-450a-a320-5e8b74ce9d46" path="/var/lib/kubelet/pods/c643392f-b5a5-450a-a320-5e8b74ce9d46/volumes"
Jul 20 03:34:27.327479 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.327444    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"]
Jul 20 03:34:27.327937 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.327842    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c5ec1c-98de-46df-b742-7827887409b9" containerName="main"
Jul 20 03:34:27.327937 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.327854    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c5ec1c-98de-46df-b742-7827887409b9" containerName="main"
Jul 20 03:34:27.327937 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.327870    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c643392f-b5a5-450a-a320-5e8b74ce9d46" containerName="main"
Jul 20 03:34:27.327937 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.327876    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c643392f-b5a5-450a-a320-5e8b74ce9d46" containerName="main"
Jul 20 03:34:27.327937 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.327929    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c643392f-b5a5-450a-a320-5e8b74ce9d46" containerName="main"
Jul 20 03:34:27.327937 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.327939    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c5ec1c-98de-46df-b742-7827887409b9" containerName="main"
Jul 20 03:34:27.332339 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.332317    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.334878 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.334854    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c1951c\"/\"openshift-service-ca.crt\""
Jul 20 03:34:27.334878 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.334865    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c1951c\"/\"default-dockercfg-46jhr\""
Jul 20 03:34:27.335072 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.334865    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c1951c\"/\"kube-root-ca.crt\""
Jul 20 03:34:27.335072 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.335007    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c1951c\"/\"rate-test-model-c1951c-kserve-self-signed-certs\""
Jul 20 03:34:27.349176 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.349146    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"]
Jul 20 03:34:27.369970 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.369933    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:34:27.394924 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.394888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe09db8f-a861-4d5e-b506-a95e7900dc58-tls-certs\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.395095 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.394931    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-dshm\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.395095 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.394967    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whzq2\" (UniqueName: \"kubernetes.io/projected/fe09db8f-a861-4d5e-b506-a95e7900dc58-kube-api-access-whzq2\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.395095 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.395004    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-model-cache\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.395095 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.395021    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-home\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.395095 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.395088    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-tmp-dir\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.495976 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.495939    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-tmp-dir\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.496170 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.495997    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe09db8f-a861-4d5e-b506-a95e7900dc58-tls-certs\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.496170 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.496020    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-dshm\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.496170 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.496050    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whzq2\" (UniqueName: \"kubernetes.io/projected/fe09db8f-a861-4d5e-b506-a95e7900dc58-kube-api-access-whzq2\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.496170 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.496071    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-model-cache\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.496170 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.496089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-home\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.496492 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.496366    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-tmp-dir\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.496800 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.496774    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-home\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.496980 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.496802    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-model-cache\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.498734 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.498708    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe09db8f-a861-4d5e-b506-a95e7900dc58-tls-certs\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.498853 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.498836    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-dshm\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.502739 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.502721    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whzq2\" (UniqueName: \"kubernetes.io/projected/fe09db8f-a861-4d5e-b506-a95e7900dc58-kube-api-access-whzq2\") pod \"rate-test-model-c1951c-kserve-7fd45b8667-lkzzm\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") " pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.642131 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.642015    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:27.772742 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:27.772713    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"]
Jul 20 03:34:27.775504 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:34:27.775475    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe09db8f_a861_4d5e_b506_a95e7900dc58.slice/crio-3d3316380ccd5e9ee8b7434498acfc7b76dcd4e0cc13e13dea0373acf6ec99f0 WatchSource:0}: Error finding container 3d3316380ccd5e9ee8b7434498acfc7b76dcd4e0cc13e13dea0373acf6ec99f0: Status 404 returned error can't find the container with id 3d3316380ccd5e9ee8b7434498acfc7b76dcd4e0cc13e13dea0373acf6ec99f0
Jul 20 03:34:28.553816 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:28.553774    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm" event={"ID":"fe09db8f-a861-4d5e-b506-a95e7900dc58","Type":"ContainerStarted","Data":"06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339"}
Jul 20 03:34:28.553816 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:28.553821    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm" event={"ID":"fe09db8f-a861-4d5e-b506-a95e7900dc58","Type":"ContainerStarted","Data":"3d3316380ccd5e9ee8b7434498acfc7b76dcd4e0cc13e13dea0373acf6ec99f0"}
Jul 20 03:34:28.569853 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:28.569802    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm" podStartSLOduration=1.569785338 podStartE2EDuration="1.569785338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 03:34:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 03:34:28.568045455 +0000 UTC m=+2976.794814158" watchObservedRunningTime="2026-07-20 03:34:28.569785338 +0000 UTC m=+2976.796554039"
Jul 20 03:34:37.643214 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:37.643174    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:37.643757 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:37.643230    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:37.655994 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:37.655969    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:37.689904 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:37.689878    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:34:37.789516 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:37.789486    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:34:38.611498 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:38.611466    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:34:45.336261 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:45.336223    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:34:45.452563 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:45.452530    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:34:56.495128 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:56.495012    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:34:56.503505 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:34:56.503486    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:35:08.426398 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:08.426365    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:09.455765 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:09.455729    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"]
Jul 20 03:35:09.474836 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:09.474803    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:10.478700 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.478667    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7313-139914754072368"]
Jul 20 03:35:10.482060 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.482042    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754072368"
Jul 20 03:35:10.483998 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.483973    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8kg5k\""
Jul 20 03:35:10.488061 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.488038    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7313-139914754072368"]
Jul 20 03:35:10.665274 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.665237    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94n29\" (UniqueName: \"kubernetes.io/projected/f6f23a75-5430-4326-bd62-3d9ca592037b-kube-api-access-94n29\") pod \"test-curl-7313-139914754072368\" (UID: \"f6f23a75-5430-4326-bd62-3d9ca592037b\") " pod="opendatahub/test-curl-7313-139914754072368"
Jul 20 03:35:10.766163 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.766076    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94n29\" (UniqueName: \"kubernetes.io/projected/f6f23a75-5430-4326-bd62-3d9ca592037b-kube-api-access-94n29\") pod \"test-curl-7313-139914754072368\" (UID: \"f6f23a75-5430-4326-bd62-3d9ca592037b\") " pod="opendatahub/test-curl-7313-139914754072368"
Jul 20 03:35:10.773801 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.773777    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94n29\" (UniqueName: \"kubernetes.io/projected/f6f23a75-5430-4326-bd62-3d9ca592037b-kube-api-access-94n29\") pod \"test-curl-7313-139914754072368\" (UID: \"f6f23a75-5430-4326-bd62-3d9ca592037b\") " pod="opendatahub/test-curl-7313-139914754072368"
Jul 20 03:35:10.791812 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.791788    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754072368"
Jul 20 03:35:10.919009 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.918984    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7313-139914754072368"]
Jul 20 03:35:10.921590 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:35:10.921548    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6f23a75_5430_4326_bd62_3d9ca592037b.slice/crio-c9dc47996ed8dfa66a1973a59fbacbc0a421670bbfdbc10dddf07667a355e351 WatchSource:0}: Error finding container c9dc47996ed8dfa66a1973a59fbacbc0a421670bbfdbc10dddf07667a355e351: Status 404 returned error can't find the container with id c9dc47996ed8dfa66a1973a59fbacbc0a421670bbfdbc10dddf07667a355e351
Jul 20 03:35:10.922900 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:10.922883    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 03:35:11.752674 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:11.752628    2584 generic.go:356] "Generic (PLEG): container finished" podID="f6f23a75-5430-4326-bd62-3d9ca592037b" containerID="7937c43e88b441df7e99d0fc055f83861ec82600080072ba927c154cdab716cf" exitCode=0
Jul 20 03:35:11.753038 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:11.752690    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7313-139914754072368" event={"ID":"f6f23a75-5430-4326-bd62-3d9ca592037b","Type":"ContainerDied","Data":"7937c43e88b441df7e99d0fc055f83861ec82600080072ba927c154cdab716cf"}
Jul 20 03:35:11.753038 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:11.752738    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7313-139914754072368" event={"ID":"f6f23a75-5430-4326-bd62-3d9ca592037b","Type":"ContainerStarted","Data":"c9dc47996ed8dfa66a1973a59fbacbc0a421670bbfdbc10dddf07667a355e351"}
Jul 20 03:35:12.890568 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:12.890541    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754072368"
Jul 20 03:35:12.909618 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:12.909586    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7313-139914754072368_f6f23a75-5430-4326-bd62-3d9ca592037b/test-curl-7313-139914754072368/0.log"
Jul 20 03:35:12.932278 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:12.932241    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7313-139914754072368"]
Jul 20 03:35:12.935198 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:12.935174    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7313-139914754072368"]
Jul 20 03:35:12.986715 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:12.986681    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94n29\" (UniqueName: \"kubernetes.io/projected/f6f23a75-5430-4326-bd62-3d9ca592037b-kube-api-access-94n29\") pod \"f6f23a75-5430-4326-bd62-3d9ca592037b\" (UID: \"f6f23a75-5430-4326-bd62-3d9ca592037b\") "
Jul 20 03:35:12.989254 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:12.989229    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f23a75-5430-4326-bd62-3d9ca592037b-kube-api-access-94n29" (OuterVolumeSpecName: "kube-api-access-94n29") pod "f6f23a75-5430-4326-bd62-3d9ca592037b" (UID: "f6f23a75-5430-4326-bd62-3d9ca592037b"). InnerVolumeSpecName "kube-api-access-94n29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:35:13.087594 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:13.087561    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94n29\" (UniqueName: \"kubernetes.io/projected/f6f23a75-5430-4326-bd62-3d9ca592037b-kube-api-access-94n29\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:13.764016 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:13.763983    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754072368"
Jul 20 03:35:13.764016 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:13.764014    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9dc47996ed8dfa66a1973a59fbacbc0a421670bbfdbc10dddf07667a355e351"
Jul 20 03:35:13.773760 ip-10-0-140-191 kubenswrapper[2584]: E0720 03:35:13.773723    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7313-139914754072368\" is forbidden: User \"system:node:ip-10-0-140-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-191.ec2.internal' and this object" podUID="f6f23a75-5430-4326-bd62-3d9ca592037b" pod="opendatahub/test-curl-7313-139914754072368"
Jul 20 03:35:14.279197 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:14.279167    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f23a75-5430-4326-bd62-3d9ca592037b" path="/var/lib/kubelet/pods/f6f23a75-5430-4326-bd62-3d9ca592037b/volumes"
Jul 20 03:35:16.497851 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.497818    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:16.498252 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.498186    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f23a75-5430-4326-bd62-3d9ca592037b" containerName="test-curl-7313-139914754072368"
Jul 20 03:35:16.498252 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.498198    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f23a75-5430-4326-bd62-3d9ca592037b" containerName="test-curl-7313-139914754072368"
Jul 20 03:35:16.498324 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.498262    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f23a75-5430-4326-bd62-3d9ca592037b" containerName="test-curl-7313-139914754072368"
Jul 20 03:35:16.501330 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.501312    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:16.503543 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.503522    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8kg5k\""
Jul 20 03:35:16.505014 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.504987    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:16.620878 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.620840    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqptv\" (UniqueName: \"kubernetes.io/projected/796108d1-29d1-47c1-97fd-f244cf00205c-kube-api-access-cqptv\") pod \"test-curl-7313-139914754213040\" (UID: \"796108d1-29d1-47c1-97fd-f244cf00205c\") " pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:16.721770 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.721735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqptv\" (UniqueName: \"kubernetes.io/projected/796108d1-29d1-47c1-97fd-f244cf00205c-kube-api-access-cqptv\") pod \"test-curl-7313-139914754213040\" (UID: \"796108d1-29d1-47c1-97fd-f244cf00205c\") " pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:16.729862 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.729828    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqptv\" (UniqueName: \"kubernetes.io/projected/796108d1-29d1-47c1-97fd-f244cf00205c-kube-api-access-cqptv\") pod \"test-curl-7313-139914754213040\" (UID: \"796108d1-29d1-47c1-97fd-f244cf00205c\") " pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:16.811787 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.811764    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:16.938195 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:16.938079    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:16.940859 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:35:16.940831    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod796108d1_29d1_47c1_97fd_f244cf00205c.slice/crio-91900538265edd9cf81dc1aa20e0b1d0931e3b20542784264191ef2dd585ca10 WatchSource:0}: Error finding container 91900538265edd9cf81dc1aa20e0b1d0931e3b20542784264191ef2dd585ca10: Status 404 returned error can't find the container with id 91900538265edd9cf81dc1aa20e0b1d0931e3b20542784264191ef2dd585ca10
Jul 20 03:35:17.782726 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:17.782697    2584 generic.go:356] "Generic (PLEG): container finished" podID="796108d1-29d1-47c1-97fd-f244cf00205c" containerID="286c8d6c13bc9e18b3724fdaabc71c3d4dca39e29a7fd6dd23f1d66e3e505d91" exitCode=0
Jul 20 03:35:17.783129 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:17.782756    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7313-139914754213040" event={"ID":"796108d1-29d1-47c1-97fd-f244cf00205c","Type":"ContainerDied","Data":"286c8d6c13bc9e18b3724fdaabc71c3d4dca39e29a7fd6dd23f1d66e3e505d91"}
Jul 20 03:35:17.783129 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:17.782788    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7313-139914754213040" event={"ID":"796108d1-29d1-47c1-97fd-f244cf00205c","Type":"ContainerStarted","Data":"91900538265edd9cf81dc1aa20e0b1d0931e3b20542784264191ef2dd585ca10"}
Jul 20 03:35:18.922672 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:18.922631    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:18.941938 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:18.941909    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7313-139914754213040_796108d1-29d1-47c1-97fd-f244cf00205c/test-curl-7313-139914754213040/0.log"
Jul 20 03:35:18.964232 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:18.964208    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:18.968248 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:18.968227    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:19.041973 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.041920    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqptv\" (UniqueName: \"kubernetes.io/projected/796108d1-29d1-47c1-97fd-f244cf00205c-kube-api-access-cqptv\") pod \"796108d1-29d1-47c1-97fd-f244cf00205c\" (UID: \"796108d1-29d1-47c1-97fd-f244cf00205c\") "
Jul 20 03:35:19.048763 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.044888    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/796108d1-29d1-47c1-97fd-f244cf00205c-kube-api-access-cqptv" (OuterVolumeSpecName: "kube-api-access-cqptv") pod "796108d1-29d1-47c1-97fd-f244cf00205c" (UID: "796108d1-29d1-47c1-97fd-f244cf00205c"). InnerVolumeSpecName "kube-api-access-cqptv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:35:19.091497 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.091470    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:19.091861 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.091848    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796108d1-29d1-47c1-97fd-f244cf00205c" containerName="test-curl-7313-139914754213040"
Jul 20 03:35:19.091913 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.091863    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="796108d1-29d1-47c1-97fd-f244cf00205c" containerName="test-curl-7313-139914754213040"
Jul 20 03:35:19.091955 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.091919    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="796108d1-29d1-47c1-97fd-f244cf00205c" containerName="test-curl-7313-139914754213040"
Jul 20 03:35:19.094773 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.094759    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:19.099702 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.099681    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:19.143332 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.143299    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfqgk\" (UniqueName: \"kubernetes.io/projected/7f6dc36a-6847-41c3-9754-26bca23d3e2e-kube-api-access-pfqgk\") pod \"test-curl-7313-139914754213040\" (UID: \"7f6dc36a-6847-41c3-9754-26bca23d3e2e\") " pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:19.143467 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.143415    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqptv\" (UniqueName: \"kubernetes.io/projected/796108d1-29d1-47c1-97fd-f244cf00205c-kube-api-access-cqptv\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:19.244461 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.244428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfqgk\" (UniqueName: \"kubernetes.io/projected/7f6dc36a-6847-41c3-9754-26bca23d3e2e-kube-api-access-pfqgk\") pod \"test-curl-7313-139914754213040\" (UID: \"7f6dc36a-6847-41c3-9754-26bca23d3e2e\") " pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:19.252747 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.252724    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfqgk\" (UniqueName: \"kubernetes.io/projected/7f6dc36a-6847-41c3-9754-26bca23d3e2e-kube-api-access-pfqgk\") pod \"test-curl-7313-139914754213040\" (UID: \"7f6dc36a-6847-41c3-9754-26bca23d3e2e\") " pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:19.404916 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.404883    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:19.529817 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.529794    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:19.532052 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:35:19.532028    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f6dc36a_6847_41c3_9754_26bca23d3e2e.slice/crio-06007cf95752b163c24b7fee29f45efacf5814f15942921a34e500ec413643ae WatchSource:0}: Error finding container 06007cf95752b163c24b7fee29f45efacf5814f15942921a34e500ec413643ae: Status 404 returned error can't find the container with id 06007cf95752b163c24b7fee29f45efacf5814f15942921a34e500ec413643ae
Jul 20 03:35:19.794132 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.794101    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:19.794303 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.794113    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91900538265edd9cf81dc1aa20e0b1d0931e3b20542784264191ef2dd585ca10"
Jul 20 03:35:19.795278 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.795253    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7313-139914754213040" event={"ID":"7f6dc36a-6847-41c3-9754-26bca23d3e2e","Type":"ContainerStarted","Data":"06007cf95752b163c24b7fee29f45efacf5814f15942921a34e500ec413643ae"}
Jul 20 03:35:19.806237 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:19.806204    2584 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7313-139914754213040" oldPodUID="796108d1-29d1-47c1-97fd-f244cf00205c" podUID="7f6dc36a-6847-41c3-9754-26bca23d3e2e"
Jul 20 03:35:20.280375 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:20.280296    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="796108d1-29d1-47c1-97fd-f244cf00205c" path="/var/lib/kubelet/pods/796108d1-29d1-47c1-97fd-f244cf00205c/volumes"
Jul 20 03:35:20.801560 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:20.801519    2584 generic.go:356] "Generic (PLEG): container finished" podID="7f6dc36a-6847-41c3-9754-26bca23d3e2e" containerID="6e9bb8cdb476999b957d77068b272729efe910bfc22e9cdac3546c1a97f95ebe" exitCode=0
Jul 20 03:35:20.801750 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:20.801599    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7313-139914754213040" event={"ID":"7f6dc36a-6847-41c3-9754-26bca23d3e2e","Type":"ContainerDied","Data":"6e9bb8cdb476999b957d77068b272729efe910bfc22e9cdac3546c1a97f95ebe"}
Jul 20 03:35:21.939343 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:21.939323    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:21.957010 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:21.956985    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7313-139914754213040_7f6dc36a-6847-41c3-9754-26bca23d3e2e/test-curl-7313-139914754213040/0.log"
Jul 20 03:35:21.962179 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:21.962156    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfqgk\" (UniqueName: \"kubernetes.io/projected/7f6dc36a-6847-41c3-9754-26bca23d3e2e-kube-api-access-pfqgk\") pod \"7f6dc36a-6847-41c3-9754-26bca23d3e2e\" (UID: \"7f6dc36a-6847-41c3-9754-26bca23d3e2e\") "
Jul 20 03:35:21.964137 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:21.964109    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f6dc36a-6847-41c3-9754-26bca23d3e2e-kube-api-access-pfqgk" (OuterVolumeSpecName: "kube-api-access-pfqgk") pod "7f6dc36a-6847-41c3-9754-26bca23d3e2e" (UID: "7f6dc36a-6847-41c3-9754-26bca23d3e2e"). InnerVolumeSpecName "kube-api-access-pfqgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:35:21.979782 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:21.979759    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:21.984941 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:21.984923    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7313-139914754213040"]
Jul 20 03:35:22.063386 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:22.063311    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfqgk\" (UniqueName: \"kubernetes.io/projected/7f6dc36a-6847-41c3-9754-26bca23d3e2e-kube-api-access-pfqgk\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:22.279702 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:22.279670    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f6dc36a-6847-41c3-9754-26bca23d3e2e" path="/var/lib/kubelet/pods/7f6dc36a-6847-41c3-9754-26bca23d3e2e/volumes"
Jul 20 03:35:22.812409 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:22.812383    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7313-139914754213040"
Jul 20 03:35:22.812409 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:22.812412    2584 scope.go:117] "RemoveContainer" containerID="6e9bb8cdb476999b957d77068b272729efe910bfc22e9cdac3546c1a97f95ebe"
Jul 20 03:35:24.477074 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.477032    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm" podUID="fe09db8f-a861-4d5e-b506-a95e7900dc58" containerName="main" containerID="cri-o://06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339" gracePeriod=45
Jul 20 03:35:24.718754 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.718725    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:35:24.782176 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782153    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-model-cache\") pod \"fe09db8f-a861-4d5e-b506-a95e7900dc58\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") "
Jul 20 03:35:24.782349 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782193    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-tmp-dir\") pod \"fe09db8f-a861-4d5e-b506-a95e7900dc58\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") "
Jul 20 03:35:24.782349 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782227    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whzq2\" (UniqueName: \"kubernetes.io/projected/fe09db8f-a861-4d5e-b506-a95e7900dc58-kube-api-access-whzq2\") pod \"fe09db8f-a861-4d5e-b506-a95e7900dc58\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") "
Jul 20 03:35:24.782349 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782266    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-home\") pod \"fe09db8f-a861-4d5e-b506-a95e7900dc58\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") "
Jul 20 03:35:24.782349 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782297    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-dshm\") pod \"fe09db8f-a861-4d5e-b506-a95e7900dc58\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") "
Jul 20 03:35:24.782349 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782324    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe09db8f-a861-4d5e-b506-a95e7900dc58-tls-certs\") pod \"fe09db8f-a861-4d5e-b506-a95e7900dc58\" (UID: \"fe09db8f-a861-4d5e-b506-a95e7900dc58\") "
Jul 20 03:35:24.782590 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782409    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe09db8f-a861-4d5e-b506-a95e7900dc58" (UID: "fe09db8f-a861-4d5e-b506-a95e7900dc58"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:35:24.782590 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782482    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe09db8f-a861-4d5e-b506-a95e7900dc58" (UID: "fe09db8f-a861-4d5e-b506-a95e7900dc58"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:35:24.782590 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782575    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-home" (OuterVolumeSpecName: "home") pod "fe09db8f-a861-4d5e-b506-a95e7900dc58" (UID: "fe09db8f-a861-4d5e-b506-a95e7900dc58"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:35:24.782733 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782717    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-model-cache\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:24.782799 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782738    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-tmp-dir\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:24.782799 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.782750    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-home\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:24.784471 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.784440    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-dshm" (OuterVolumeSpecName: "dshm") pod "fe09db8f-a861-4d5e-b506-a95e7900dc58" (UID: "fe09db8f-a861-4d5e-b506-a95e7900dc58"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 03:35:24.784471 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.784449    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe09db8f-a861-4d5e-b506-a95e7900dc58-kube-api-access-whzq2" (OuterVolumeSpecName: "kube-api-access-whzq2") pod "fe09db8f-a861-4d5e-b506-a95e7900dc58" (UID: "fe09db8f-a861-4d5e-b506-a95e7900dc58"). InnerVolumeSpecName "kube-api-access-whzq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 03:35:24.784611 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.784472    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe09db8f-a861-4d5e-b506-a95e7900dc58-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe09db8f-a861-4d5e-b506-a95e7900dc58" (UID: "fe09db8f-a861-4d5e-b506-a95e7900dc58"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 03:35:24.822750 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.822722    2584 generic.go:356] "Generic (PLEG): container finished" podID="fe09db8f-a861-4d5e-b506-a95e7900dc58" containerID="06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339" exitCode=0
Jul 20 03:35:24.822868 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.822764    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"
Jul 20 03:35:24.822868 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.822811    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm" event={"ID":"fe09db8f-a861-4d5e-b506-a95e7900dc58","Type":"ContainerDied","Data":"06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339"}
Jul 20 03:35:24.822868 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.822852    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm" event={"ID":"fe09db8f-a861-4d5e-b506-a95e7900dc58","Type":"ContainerDied","Data":"3d3316380ccd5e9ee8b7434498acfc7b76dcd4e0cc13e13dea0373acf6ec99f0"}
Jul 20 03:35:24.822990 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.822870    2584 scope.go:117] "RemoveContainer" containerID="06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339"
Jul 20 03:35:24.831376 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.831360    2584 scope.go:117] "RemoveContainer" containerID="06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339"
Jul 20 03:35:24.831609 ip-10-0-140-191 kubenswrapper[2584]: E0720 03:35:24.831593    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339\": container with ID starting with 06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339 not found: ID does not exist" containerID="06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339"
Jul 20 03:35:24.831679 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.831616    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339"} err="failed to get container status \"06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339\": rpc error: code = NotFound desc = could not find container \"06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339\": container with ID starting with 06296bffe45f32cbf6b9eca9621bad2ac9415b060d54ce23d58e3a811f296339 not found: ID does not exist"
Jul 20 03:35:24.843053 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.843034    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"]
Jul 20 03:35:24.844567 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.844548    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c1951c/rate-test-model-c1951c-kserve-7fd45b8667-lkzzm"]
Jul 20 03:35:24.883398 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.883369    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whzq2\" (UniqueName: \"kubernetes.io/projected/fe09db8f-a861-4d5e-b506-a95e7900dc58-kube-api-access-whzq2\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:24.883398 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.883395    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe09db8f-a861-4d5e-b506-a95e7900dc58-dshm\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:24.883549 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:24.883406    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe09db8f-a861-4d5e-b506-a95e7900dc58-tls-certs\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:26.279551 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:26.279517    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe09db8f-a861-4d5e-b506-a95e7900dc58" path="/var/lib/kubelet/pods/fe09db8f-a861-4d5e-b506-a95e7900dc58/volumes"
Jul 20 03:35:27.563767 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.563731    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"]
Jul 20 03:35:27.564159 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.564103    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f6dc36a-6847-41c3-9754-26bca23d3e2e" containerName="test-curl-7313-139914754213040"
Jul 20 03:35:27.564159 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.564116    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f6dc36a-6847-41c3-9754-26bca23d3e2e" containerName="test-curl-7313-139914754213040"
Jul 20 03:35:27.564159 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.564133    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe09db8f-a861-4d5e-b506-a95e7900dc58" containerName="main"
Jul 20 03:35:27.564159 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.564139    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe09db8f-a861-4d5e-b506-a95e7900dc58" containerName="main"
Jul 20 03:35:27.564288 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.564203    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f6dc36a-6847-41c3-9754-26bca23d3e2e" containerName="test-curl-7313-139914754213040"
Jul 20 03:35:27.564288 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.564211    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe09db8f-a861-4d5e-b506-a95e7900dc58" containerName="main"
Jul 20 03:35:27.568451 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.568436    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"
Jul 20 03:35:27.570364 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.570346    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hlzh6\""
Jul 20 03:35:27.570486 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.570347    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 03:35:27.573372 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.573350    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"]
Jul 20 03:35:27.603150 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.603120    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a12fb62-28be-4223-b86f-870360650a9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-496193-t6qj2\" (UID: \"2a12fb62-28be-4223-b86f-870360650a9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"
Jul 20 03:35:27.703996 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.703964    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a12fb62-28be-4223-b86f-870360650a9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-496193-t6qj2\" (UID: \"2a12fb62-28be-4223-b86f-870360650a9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"
Jul 20 03:35:27.704555 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.704537    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a12fb62-28be-4223-b86f-870360650a9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-496193-t6qj2\" (UID: \"2a12fb62-28be-4223-b86f-870360650a9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"
Jul 20 03:35:27.881193 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:27.881107    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"
Jul 20 03:35:28.015823 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:28.015779    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"]
Jul 20 03:35:28.018537 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:35:28.018506    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a12fb62_28be_4223_b86f_870360650a9f.slice/crio-1d4673c9de13252d9b21032bd8f64e185ee6b7c28fd5bf56bccd32d7b726c237 WatchSource:0}: Error finding container 1d4673c9de13252d9b21032bd8f64e185ee6b7c28fd5bf56bccd32d7b726c237: Status 404 returned error can't find the container with id 1d4673c9de13252d9b21032bd8f64e185ee6b7c28fd5bf56bccd32d7b726c237
Jul 20 03:35:28.050959 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:28.050931    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:28.151460 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:28.151380    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:28.846985 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:28.846950    2584 generic.go:356] "Generic (PLEG): container finished" podID="2a12fb62-28be-4223-b86f-870360650a9f" containerID="d50afb35bca49726b804b154ecebedb6a8e697cb49c7bd99aa17e2a9050c0e75" exitCode=0
Jul 20 03:35:28.847476 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:28.847019    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2" event={"ID":"2a12fb62-28be-4223-b86f-870360650a9f","Type":"ContainerDied","Data":"d50afb35bca49726b804b154ecebedb6a8e697cb49c7bd99aa17e2a9050c0e75"}
Jul 20 03:35:28.847476 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:28.847110    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2" event={"ID":"2a12fb62-28be-4223-b86f-870360650a9f","Type":"ContainerStarted","Data":"1d4673c9de13252d9b21032bd8f64e185ee6b7c28fd5bf56bccd32d7b726c237"}
Jul 20 03:35:29.977712 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:29.977689    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"
Jul 20 03:35:30.017812 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:30.017779    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a12fb62-28be-4223-b86f-870360650a9f-maas-api-service-ca\") pod \"2a12fb62-28be-4223-b86f-870360650a9f\" (UID: \"2a12fb62-28be-4223-b86f-870360650a9f\") "
Jul 20 03:35:30.018127 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:30.018104    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a12fb62-28be-4223-b86f-870360650a9f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2a12fb62-28be-4223-b86f-870360650a9f" (UID: "2a12fb62-28be-4223-b86f-870360650a9f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 03:35:30.118863 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:30.118774    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a12fb62-28be-4223-b86f-870360650a9f-maas-api-service-ca\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:30.857467 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:30.857440    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"
Jul 20 03:35:30.857667 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:30.857478    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2" event={"ID":"2a12fb62-28be-4223-b86f-870360650a9f","Type":"ContainerDied","Data":"1d4673c9de13252d9b21032bd8f64e185ee6b7c28fd5bf56bccd32d7b726c237"}
Jul 20 03:35:30.857667 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:30.857523    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d4673c9de13252d9b21032bd8f64e185ee6b7c28fd5bf56bccd32d7b726c237"
Jul 20 03:35:32.812311 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:32.812277    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:38.119573 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:38.119536    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:42.631573 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:42.631538    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:42.647383 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:42.647353    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"]
Jul 20 03:35:42.649354 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:42.649332    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-496193-t6qj2"]
Jul 20 03:35:43.037472 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:43.037443    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:44.279429 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:44.279359    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a12fb62-28be-4223-b86f-870360650a9f" path="/var/lib/kubelet/pods/2a12fb62-28be-4223-b86f-870360650a9f/volumes"
Jul 20 03:35:48.703976 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:48.703928    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:48.807020 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:48.806992    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:49.030129 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.030039    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:49.277804 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.277774    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:49.391075 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.391044    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"]
Jul 20 03:35:49.391414 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.391401    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a12fb62-28be-4223-b86f-870360650a9f" containerName="revoke-keys"
Jul 20 03:35:49.391457 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.391416    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a12fb62-28be-4223-b86f-870360650a9f" containerName="revoke-keys"
Jul 20 03:35:49.391495 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.391484    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a12fb62-28be-4223-b86f-870360650a9f" containerName="revoke-keys"
Jul 20 03:35:49.396162 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.396147    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"
Jul 20 03:35:49.399171 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.399140    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 03:35:49.399315 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.399183    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hlzh6\""
Jul 20 03:35:49.400605 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.400577    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"]
Jul 20 03:35:49.445318 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.445285    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fd66e7-35b3-46a8-af1b-99ff493abc6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22\" (UID: \"e5fd66e7-35b3-46a8-af1b-99ff493abc6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"
Jul 20 03:35:49.545804 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.545764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fd66e7-35b3-46a8-af1b-99ff493abc6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22\" (UID: \"e5fd66e7-35b3-46a8-af1b-99ff493abc6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"
Jul 20 03:35:49.546438 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.546417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fd66e7-35b3-46a8-af1b-99ff493abc6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22\" (UID: \"e5fd66e7-35b3-46a8-af1b-99ff493abc6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"
Jul 20 03:35:49.708009 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.707923    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"
Jul 20 03:35:49.837530 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.837444    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"]
Jul 20 03:35:49.840067 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:35:49.840043    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fd66e7_35b3_46a8_af1b_99ff493abc6e.slice/crio-de28a21625093cdd37e7aeaa95e706a073977a19b06c7461182b439a3e1dc64d WatchSource:0}: Error finding container de28a21625093cdd37e7aeaa95e706a073977a19b06c7461182b439a3e1dc64d: Status 404 returned error can't find the container with id de28a21625093cdd37e7aeaa95e706a073977a19b06c7461182b439a3e1dc64d
Jul 20 03:35:49.895910 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.895881    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:49.948739 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.948700    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22" event={"ID":"e5fd66e7-35b3-46a8-af1b-99ff493abc6e","Type":"ContainerStarted","Data":"de28a21625093cdd37e7aeaa95e706a073977a19b06c7461182b439a3e1dc64d"}
Jul 20 03:35:49.996965 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:49.996875    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:35:50.954801 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:50.954709    2584 generic.go:356] "Generic (PLEG): container finished" podID="e5fd66e7-35b3-46a8-af1b-99ff493abc6e" containerID="1a30765d19b18c8fcfd606c813d9acb6c548eaf6c8ab69ee725cef9e50828276" exitCode=0
Jul 20 03:35:50.954801 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:50.954743    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22" event={"ID":"e5fd66e7-35b3-46a8-af1b-99ff493abc6e","Type":"ContainerDied","Data":"1a30765d19b18c8fcfd606c813d9acb6c548eaf6c8ab69ee725cef9e50828276"}
Jul 20 03:35:52.090231 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:52.090208    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"
Jul 20 03:35:52.171262 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:52.171230    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fd66e7-35b3-46a8-af1b-99ff493abc6e-maas-api-service-ca\") pod \"e5fd66e7-35b3-46a8-af1b-99ff493abc6e\" (UID: \"e5fd66e7-35b3-46a8-af1b-99ff493abc6e\") "
Jul 20 03:35:52.171543 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:52.171523    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5fd66e7-35b3-46a8-af1b-99ff493abc6e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e5fd66e7-35b3-46a8-af1b-99ff493abc6e" (UID: "e5fd66e7-35b3-46a8-af1b-99ff493abc6e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 03:35:52.272357 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:52.272277    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fd66e7-35b3-46a8-af1b-99ff493abc6e-maas-api-service-ca\") on node \"ip-10-0-140-191.ec2.internal\" DevicePath \"\""
Jul 20 03:35:52.965033 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:52.964954    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"
Jul 20 03:35:52.965033 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:52.964983    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22" event={"ID":"e5fd66e7-35b3-46a8-af1b-99ff493abc6e","Type":"ContainerDied","Data":"de28a21625093cdd37e7aeaa95e706a073977a19b06c7461182b439a3e1dc64d"}
Jul 20 03:35:52.965033 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:52.965030    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de28a21625093cdd37e7aeaa95e706a073977a19b06c7461182b439a3e1dc64d"
Jul 20 03:35:59.816984 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:35:59.816943    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:00.140006 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:00.139915    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:00.188702 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:00.188676    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:04.499919 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:04.499886    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"]
Jul 20 03:36:04.502058 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:04.502034    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c1951c-7nf22"]
Jul 20 03:36:04.504064 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:04.504042    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:04.900063 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:04.900034    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:06.279003 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:06.278970    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5fd66e7-35b3-46a8-af1b-99ff493abc6e" path="/var/lib/kubelet/pods/e5fd66e7-35b3-46a8-af1b-99ff493abc6e/volumes"
Jul 20 03:36:11.169493 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:11.169457    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:11.273851 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:11.273814    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:11.480683 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:11.480586    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:11.703295 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:11.703256    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:18.144894 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:18.144863    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7gft5_ff584845-ed7b-4fb8-b41c-701c408c63c3/server/0.log"
Jul 20 03:36:18.266486 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:18.266455    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-skc2d_6573960a-43f6-449e-b041-68c30cfed3b8/manager/0.log"
Jul 20 03:36:18.669193 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:18.669164    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2_f52c4128-4bc4-4d6e-b602-2c1d6e871fd0/copy-manifests/0.log"
Jul 20 03:36:18.675853 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:18.675818    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2_f52c4128-4bc4-4d6e-b602-2c1d6e871fd0/manager/0.log"
Jul 20 03:36:22.138079 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:22.138046    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gpvls_b641f054-9d7c-4ff5-9b00-401ba02062f7/discovery/0.log"
Jul 20 03:36:22.251419 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:22.251388    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d88568984-mj96h_fc112aee-e010-4ea0-9630-9d6ca975f1ce/kube-auth-proxy/0.log"
Jul 20 03:36:22.859440 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:22.859416    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67656b96-dhf9s_35ca8fae-ee04-44bc-af17-fb63f987b537/router/0.log"
Jul 20 03:36:29.567469 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:29.567422    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:29.632938 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:29.632901    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:29.733266 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:29.733227    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:29.833788 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:29.833698    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log" limit=1024
Jul 20 03:36:32.118013 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:32.117983    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6xhcn_4369624d-875b-416a-927a-80928ed35f04/global-pull-secret-syncer/0.log"
Jul 20 03:36:32.236012 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:32.235980    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7rvrp_f8f8406a-9cb8-4430-a338-4d5400caa917/konnectivity-agent/0.log"
Jul 20 03:36:32.333408 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:32.333380    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-191.ec2.internal_8ab3262203e6413ceb558164a98b82dd/haproxy/0.log"
Jul 20 03:36:39.860565 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:39.860534    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b745520c-1dbd-4350-9be4-994400681c33/alertmanager/0.log"
Jul 20 03:36:39.880511 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:39.880484    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b745520c-1dbd-4350-9be4-994400681c33/config-reloader/0.log"
Jul 20 03:36:39.902308 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:39.902284    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b745520c-1dbd-4350-9be4-994400681c33/kube-rbac-proxy-web/0.log"
Jul 20 03:36:39.923042 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:39.923017    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b745520c-1dbd-4350-9be4-994400681c33/kube-rbac-proxy/0.log"
Jul 20 03:36:39.941963 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:39.941934    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b745520c-1dbd-4350-9be4-994400681c33/kube-rbac-proxy-metric/0.log"
Jul 20 03:36:39.961408 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:39.961380    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b745520c-1dbd-4350-9be4-994400681c33/prom-label-proxy/0.log"
Jul 20 03:36:39.980677 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:39.980631    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b745520c-1dbd-4350-9be4-994400681c33/init-config-reloader/0.log"
Jul 20 03:36:40.018430 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.018367    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-r4xh8_42629dc9-3a3d-459a-9b9d-7bd58a785c80/cluster-monitoring-operator/0.log"
Jul 20 03:36:40.132243 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.132216    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-l9d89_e2023c6b-ccd9-4e21-bb78-9c7d996e984a/monitoring-plugin/0.log"
Jul 20 03:36:40.319820 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.319789    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9n29_7aefd175-49cf-4963-8ebb-36e238849ae1/node-exporter/0.log"
Jul 20 03:36:40.338919 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.338893    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9n29_7aefd175-49cf-4963-8ebb-36e238849ae1/kube-rbac-proxy/0.log"
Jul 20 03:36:40.358172 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.358152    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9n29_7aefd175-49cf-4963-8ebb-36e238849ae1/init-textfile/0.log"
Jul 20 03:36:40.625612 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.625534    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tm67p_dd050399-cbce-4493-8c9d-77c8271b3736/prometheus-operator/0.log"
Jul 20 03:36:40.643495 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.643469    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tm67p_dd050399-cbce-4493-8c9d-77c8271b3736/kube-rbac-proxy/0.log"
Jul 20 03:36:40.691572 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.691544    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c466df9c8-bzrnz_70dc7872-a087-4a3d-b948-e9199504ec86/telemeter-client/0.log"
Jul 20 03:36:40.712788 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.712763    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c466df9c8-bzrnz_70dc7872-a087-4a3d-b948-e9199504ec86/reload/0.log"
Jul 20 03:36:40.728081 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:40.728062    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c466df9c8-bzrnz_70dc7872-a087-4a3d-b948-e9199504ec86/kube-rbac-proxy/0.log"
Jul 20 03:36:42.028148 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.028109    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-sxpjx_2e4e21eb-855e-4a48-8424-5d9d4791a858/networking-console-plugin/0.log"
Jul 20 03:36:42.212075 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.212043    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"]
Jul 20 03:36:42.212416 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.212402    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5fd66e7-35b3-46a8-af1b-99ff493abc6e" containerName="revoke-keys"
Jul 20 03:36:42.212460 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.212419    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5fd66e7-35b3-46a8-af1b-99ff493abc6e" containerName="revoke-keys"
Jul 20 03:36:42.212498 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.212491    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5fd66e7-35b3-46a8-af1b-99ff493abc6e" containerName="revoke-keys"
Jul 20 03:36:42.215698 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.215679    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.217537 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.217518    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spsmj\"/\"openshift-service-ca.crt\""
Jul 20 03:36:42.218073 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.218055    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-spsmj\"/\"default-dockercfg-6h8fx\""
Jul 20 03:36:42.218160 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.218072    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spsmj\"/\"kube-root-ca.crt\""
Jul 20 03:36:42.224075 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.224050    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"]
Jul 20 03:36:42.296723 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.296697    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-sys\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.296898 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.296735    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-lib-modules\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.296898 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.296754    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqkdv\" (UniqueName: \"kubernetes.io/projected/e7e7dd41-f5e7-4389-a698-36f6cb854279-kube-api-access-pqkdv\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.296898 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.296822    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-podres\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.296898 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.296878    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-proc\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.397721 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.397675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-sys\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.397874 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.397732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-lib-modules\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.397874 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.397756    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqkdv\" (UniqueName: \"kubernetes.io/projected/e7e7dd41-f5e7-4389-a698-36f6cb854279-kube-api-access-pqkdv\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.397874 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.397796    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-podres\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.397874 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.397824    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-proc\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.397874 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.397806    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-sys\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.398089 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.397907    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-proc\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.398089 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.397919    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-lib-modules\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.398089 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.397929    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7e7dd41-f5e7-4389-a698-36f6cb854279-podres\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.405531 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.405507    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqkdv\" (UniqueName: \"kubernetes.io/projected/e7e7dd41-f5e7-4389-a698-36f6cb854279-kube-api-access-pqkdv\") pod \"perf-node-gather-daemonset-n22x5\" (UID: \"e7e7dd41-f5e7-4389-a698-36f6cb854279\") " pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.525940 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.525897    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:42.658554 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:42.658504    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"]
Jul 20 03:36:42.660909 ip-10-0-140-191 kubenswrapper[2584]: W0720 03:36:42.660884    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7e7dd41_f5e7_4389_a698_36f6cb854279.slice/crio-9222d6fc5dac2912f2ab1d64063739bcf860b5fe763e4306519b81e05e2972ab WatchSource:0}: Error finding container 9222d6fc5dac2912f2ab1d64063739bcf860b5fe763e4306519b81e05e2972ab: Status 404 returned error can't find the container with id 9222d6fc5dac2912f2ab1d64063739bcf860b5fe763e4306519b81e05e2972ab
Jul 20 03:36:43.200762 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:43.200727    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5" event={"ID":"e7e7dd41-f5e7-4389-a698-36f6cb854279","Type":"ContainerStarted","Data":"8e47c6a1051657b33bcbf406f5b16ed9b5cda8dcbc79029a85b0a80f836e3257"}
Jul 20 03:36:43.201162 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:43.200803    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5" event={"ID":"e7e7dd41-f5e7-4389-a698-36f6cb854279","Type":"ContainerStarted","Data":"9222d6fc5dac2912f2ab1d64063739bcf860b5fe763e4306519b81e05e2972ab"}
Jul 20 03:36:43.201162 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:43.200859    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:43.214388 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:43.214346    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5" podStartSLOduration=1.21433195 podStartE2EDuration="1.21433195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 03:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 03:36:43.213433023 +0000 UTC m=+3111.440201725" watchObservedRunningTime="2026-07-20 03:36:43.21433195 +0000 UTC m=+3111.441100652"
Jul 20 03:36:43.236037 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:43.236011    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-87jzx_0d9a255a-7ec0-44dc-a7e0-c34b00328c8a/download-server/0.log"
Jul 20 03:36:43.781517 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:43.781479    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-vs27r_a51b4b84-4ec8-47f3-b939-51017ed10daf/volume-data-source-validator/0.log"
Jul 20 03:36:44.759824 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:44.759797    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bnqc8_83c8b733-cd7c-47e5-b02a-30d52a36766a/dns/0.log"
Jul 20 03:36:44.802260 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:44.802231    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bnqc8_83c8b733-cd7c-47e5-b02a-30d52a36766a/kube-rbac-proxy/0.log"
Jul 20 03:36:45.000312 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:45.000275    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vpdbw_225e9e97-1891-45b6-a07c-9757e8e87138/dns-node-resolver/0.log"
Jul 20 03:36:45.556401 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:45.556372    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kv9sm_6fb1844f-0bb1-4982-b830-39500f72b0ef/node-ca/0.log"
Jul 20 03:36:46.605320 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:46.605288    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gpvls_b641f054-9d7c-4ff5-9b00-401ba02062f7/discovery/0.log"
Jul 20 03:36:46.625718 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:46.625694    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d88568984-mj96h_fc112aee-e010-4ea0-9630-9d6ca975f1ce/kube-auth-proxy/0.log"
Jul 20 03:36:46.784944 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:46.784916    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67656b96-dhf9s_35ca8fae-ee04-44bc-af17-fb63f987b537/router/0.log"
Jul 20 03:36:47.489473 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:47.489439    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lcdxk_6dff67a4-0a44-4ab9-8614-ca174b41e699/serve-healthcheck-canary/0.log"
Jul 20 03:36:47.961195 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:47.961169    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jspkh_b7d6f323-62eb-4e28-add3-d8fb80de0bcc/insights-operator/0.log"
Jul 20 03:36:47.962550 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:47.962533    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jspkh_b7d6f323-62eb-4e28-add3-d8fb80de0bcc/insights-operator/1.log"
Jul 20 03:36:48.046251 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:48.046217    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpw9n_dd3a7e3f-385a-41d9-b3be-9769fe107b3f/kube-rbac-proxy/0.log"
Jul 20 03:36:48.066255 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:48.066228    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpw9n_dd3a7e3f-385a-41d9-b3be-9769fe107b3f/exporter/0.log"
Jul 20 03:36:48.086995 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:48.086969    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpw9n_dd3a7e3f-385a-41d9-b3be-9769fe107b3f/extractor/0.log"
Jul 20 03:36:49.215183 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:49.215145    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-spsmj/perf-node-gather-daemonset-n22x5"
Jul 20 03:36:50.521072 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:50.521043    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7gft5_ff584845-ed7b-4fb8-b41c-701c408c63c3/server/0.log"
Jul 20 03:36:50.590307 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:50.590272    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-skc2d_6573960a-43f6-449e-b041-68c30cfed3b8/manager/0.log"
Jul 20 03:36:50.762143 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:50.762095    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2_f52c4128-4bc4-4d6e-b602-2c1d6e871fd0/manager/0.log"
Jul 20 03:36:50.782234 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:50.782215    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8fbd65f7-x5ms2_f52c4128-4bc4-4d6e-b602-2c1d6e871fd0/copy-manifests/0.log"
Jul 20 03:36:52.004874 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:52.004846    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66bc978c4c-xg94l_286c3444-0420-4d25-b64a-bdb67adfe4e9/manager/0.log"
Jul 20 03:36:52.545293 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:52.545266    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gpvls_b641f054-9d7c-4ff5-9b00-401ba02062f7/discovery/0.log"
Jul 20 03:36:52.555453 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:52.555426    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d88568984-mj96h_fc112aee-e010-4ea0-9630-9d6ca975f1ce/kube-auth-proxy/0.log"
Jul 20 03:36:52.681489 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:52.681456    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67656b96-dhf9s_35ca8fae-ee04-44bc-af17-fb63f987b537/router/0.log"
Jul 20 03:36:54.028201 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:54.028154    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gpvls_b641f054-9d7c-4ff5-9b00-401ba02062f7/discovery/0.log"
Jul 20 03:36:54.042801 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:54.042773    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d88568984-mj96h_fc112aee-e010-4ea0-9630-9d6ca975f1ce/kube-auth-proxy/0.log"
Jul 20 03:36:54.169284 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:54.169254    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67656b96-dhf9s_35ca8fae-ee04-44bc-af17-fb63f987b537/router/0.log"
Jul 20 03:36:56.991089 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:56.991058    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-m98qm_d4024cf1-1c72-4b59-8771-f44de5c7188f/migrator/0.log"
Jul 20 03:36:57.025570 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:57.025549    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-m98qm_d4024cf1-1c72-4b59-8771-f44de5c7188f/graceful-termination/0.log"
Jul 20 03:36:57.363608 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:57.363571    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-nfdqq_9f5a15af-3d20-4917-b235-23d3d270cedb/kube-storage-version-migrator-operator/1.log"
Jul 20 03:36:57.364437 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:57.364407    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-nfdqq_9f5a15af-3d20-4917-b235-23d3d270cedb/kube-storage-version-migrator-operator/0.log"
Jul 20 03:36:58.406095 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.406063    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64t7m_e97a520a-d34e-48b1-bfc3-e4ad68daab2f/kube-multus-additional-cni-plugins/0.log"
Jul 20 03:36:58.425344 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.425317    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64t7m_e97a520a-d34e-48b1-bfc3-e4ad68daab2f/egress-router-binary-copy/0.log"
Jul 20 03:36:58.444347 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.444321    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64t7m_e97a520a-d34e-48b1-bfc3-e4ad68daab2f/cni-plugins/0.log"
Jul 20 03:36:58.463014 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.462989    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64t7m_e97a520a-d34e-48b1-bfc3-e4ad68daab2f/bond-cni-plugin/0.log"
Jul 20 03:36:58.482266 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.482242    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64t7m_e97a520a-d34e-48b1-bfc3-e4ad68daab2f/routeoverride-cni/0.log"
Jul 20 03:36:58.501958 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.501938    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64t7m_e97a520a-d34e-48b1-bfc3-e4ad68daab2f/whereabouts-cni-bincopy/0.log"
Jul 20 03:36:58.519624 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.519598    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64t7m_e97a520a-d34e-48b1-bfc3-e4ad68daab2f/whereabouts-cni/0.log"
Jul 20 03:36:58.824423 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.824395    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kjs8w_ed646a9b-9280-4d49-bd09-125c0e528da7/kube-multus/0.log"
Jul 20 03:36:58.875009 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.874965    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-284dq_9788e27f-288e-4bf0-99ce-aa3440d843a5/network-metrics-daemon/0.log"
Jul 20 03:36:58.892649 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:58.892625    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-284dq_9788e27f-288e-4bf0-99ce-aa3440d843a5/kube-rbac-proxy/0.log"
Jul 20 03:36:59.746542 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:59.746513    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-controller/0.log"
Jul 20 03:36:59.762532 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:59.762505    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/0.log"
Jul 20 03:36:59.763060 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:59.763044    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovn-acl-logging/1.log"
Jul 20 03:36:59.781050 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:59.781032    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/kube-rbac-proxy-node/0.log"
Jul 20 03:36:59.801270 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:59.801252    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 03:36:59.816869 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:59.816849    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/northd/0.log"
Jul 20 03:36:59.836486 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:59.836471    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/nbdb/0.log"
Jul 20 03:36:59.856038 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:59.856016    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/sbdb/0.log"
Jul 20 03:36:59.905489 ip-10-0-140-191 kubenswrapper[2584]: I0720 03:36:59.905462    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drpnm_c28062c6-fd4b-4d1c-9f84-fec38088ea7c/ovnkube-controller/0.log"