Jul 23 12:09:56.664757 ip-10-0-133-105 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 12:09:57.019963 ip-10-0-133-105 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 12:09:57.019963 ip-10-0-133-105 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 12:09:57.019963 ip-10-0-133-105 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 12:09:57.019963 ip-10-0-133-105 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 12:09:57.019963 ip-10-0-133-105 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 12:09:57.019963 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.019131    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023097    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023109    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023112    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023116    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023119    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023122    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023125    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023127    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023130    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023133    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023135    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023138    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023140    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023143    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023146    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023148    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023151    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023153    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023156    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 12:09:57.063496 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023159    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023162    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023165    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023168    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023171    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023175    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023179    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023181    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023184    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023187    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023190    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023193    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023195    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023198    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023200    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023202    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023205    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023208    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023210    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023213    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 12:09:57.065153 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023215    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023217    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023220    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023222    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023225    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023228    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023231    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023233    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023236    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023238    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023241    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023245    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023247    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023250    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023254    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023258    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023261    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023264    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023267    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 12:09:57.085115 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023270    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023272    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023275    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023278    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023281    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023283    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023286    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023288    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023291    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023293    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023296    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023298    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023301    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023303    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023307    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023309    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023312    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023314    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023317    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 12:09:57.086710 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023321    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023323    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023326    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023328    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023331    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023334    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023336    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023339    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023341    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023344    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023347    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023349    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023352    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023354    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023357    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023359    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023362    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023364    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023368    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023372    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 12:09:57.106239 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023374    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 12:09:57.092803 ip-10-0-133-105 systemd[1]: Started Kubernetes Kubelet.
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.023377    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024162    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024168    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024171    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024175    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024180    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024183    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024186    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024190    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024193    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024195    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024198    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024202    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024204    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024208    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024211    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024214    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024216    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024219    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 12:09:57.111137 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024221    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024224    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024226    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024229    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024231    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024234    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024237    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024239    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024242    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024244    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024247    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024249    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024253    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024255    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024258    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024260    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024262    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024265    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024267    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024270    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 12:09:57.328425 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024273    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024276    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024279    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024281    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024284    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024286    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024289    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024292    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024294    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024297    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024299    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024302    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024304    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024307    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024309    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024312    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024314    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024318    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024321    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 12:09:57.344852 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024325    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024328    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024331    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024333    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024336    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024339    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024342    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024345    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024347    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024350    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024352    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024355    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024358    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024360    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024363    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024366    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024368    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024371    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024373    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024376    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 12:09:57.346792 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024379    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024381    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024384    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024386    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024389    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024392    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024394    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024397    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024399    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024402    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024405    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024407    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024410    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024412    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024414    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024417    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024419    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024423    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024426    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024429    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 12:09:57.347451 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024432    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024434    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024825    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024830    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024835    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024839    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024843    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024846    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024853    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024856    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024859    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024861    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024864    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024867    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024872    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024874    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024877    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024879    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024882    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024884    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 12:09:57.348311 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024887    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024889    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024892    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024894    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024897    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024899    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024902    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024904    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024907    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024909    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024912    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024914    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024917    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024936    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024939    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024942    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024945    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024949    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024952    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024955    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 12:09:57.352390 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024958    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024961    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024964    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024966    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024969    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024972    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024976    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024979    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024982    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024984    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024987    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024989    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024992    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024994    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.024997    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025000    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025004    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025007    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025009    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 12:09:57.353230 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025012    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025015    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025018    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025021    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025023    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025026    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025029    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025031    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025033    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025036    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025039    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025042    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025044    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025048    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025051    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025054    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025056    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025059    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025061    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 12:09:57.353858 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025065    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025068    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025070    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025073    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025075    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025078    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025081    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025083    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025086    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025088    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025091    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025093    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025096    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025098    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025100    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025103    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025105    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025108    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025110    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025113    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 12:09:57.355345 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025115    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025118    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025120    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025185    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025192    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025197    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025203    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025206    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025210    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025214    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025218    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025222    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025226    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025230    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025233    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025237    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025239    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025243    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025246    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025248    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025251    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025256    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025259    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025262    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 12:09:57.355980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025265    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025268    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025272    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025275    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025278    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025281    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025284    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025287    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025290    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025293    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025296    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025300    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025303    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025306    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025310    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025313    2570 flags.go:64] FLAG: --enable-server="true"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025315    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025320    2570 flags.go:64] FLAG: --event-burst="100"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025324    2570 flags.go:64] FLAG: --event-qps="50"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025327    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025332    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025335    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025342    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025345    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025348    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 12:09:57.356832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025351    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025354    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025357    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025360    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025363    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025365    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025368    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025371    2570 flags.go:64] FLAG: --feature-gates=""
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025375    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025377    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025380    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025384    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025386    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025389    2570 flags.go:64] FLAG: --help="false"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025392    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025395    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025398    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025401    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025404    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025407    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025410    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025415    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025417    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 12:09:57.358730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025420    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025423    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025426    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025429    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025434    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025436    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025439    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025443    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025446    2570 flags.go:64] FLAG: --lock-file=""
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025448    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025451    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025454    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025459    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025462    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025465    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025486    2570 flags.go:64] FLAG: --logging-format="text"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025489    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025492    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025495    2570 flags.go:64] FLAG: --manifest-url=""
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025498    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025502    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025505    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025511    2570 flags.go:64] FLAG: --max-pods="110"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025514    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025517    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 12:09:57.359394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025520    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025523    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025526    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025529    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025532    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025540    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025543    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025546    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025548    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025551    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025557    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025561    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025564    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025567    2570 flags.go:64] FLAG: --port="10250"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025570    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025574    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-083ab71f214d7dd51"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025577    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025580    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025583    2570 flags.go:64] FLAG: --register-node="true"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025585    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025589    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025592    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025595    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025597    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025601    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 12:09:57.360206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025604    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025607    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025610    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025613    2570 flags.go:64] FLAG: --runonce="false"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025615    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025618    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025621    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025624    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025627    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025630    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025633    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025636    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025639    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025643    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025646    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025649    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025652    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025655    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025659    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025665    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025668    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025670    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025675    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025678    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025681    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 12:09:57.360929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025684    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025687    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025689    2570 flags.go:64] FLAG: --v="2"
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025693    2570 flags.go:64] FLAG: --version="false"
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025697    2570 flags.go:64] FLAG: --vmodule=""
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025701    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.025705    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025813    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025817    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025820    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025823    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025825    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025828    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025831    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025834    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025836    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025838    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025841    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025843    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025846    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025850    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 12:09:57.361694 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025852    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025855    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025857    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025860    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025865    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025867    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025870    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025873    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025875    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025878    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025881    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025883    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025886    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025888    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025891    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025894    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025898    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025900    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025903    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 12:09:57.362289 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025906    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025908    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025911    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025913    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025916    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025918    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025921    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025923    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025926    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025929    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025931    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025934    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025937    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025940    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025943    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025945    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025948    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025952    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025954    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025957    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 12:09:57.362949 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025960    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025962    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025965    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025967    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025970    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025973    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025975    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025978    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025981    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025983    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025986    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025988    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025991    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025993    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025996    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.025998    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026001    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026010    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026014    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026017    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 12:09:57.363599 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026019    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026022    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026024    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026027    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026031    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026033    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026036    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026038    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026041    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026045    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026048    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026051    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026053    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026056    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026058    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026061    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026063    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026069    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026072    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026076    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 12:09:57.364263 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026079    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026083    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026087    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026090    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026092    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.026095    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.026613    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.033499    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.033623    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.033641    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.033649    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033713    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033718    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033721    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 12:09:57.365100 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033724    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033727    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033729    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033732    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033735    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033738    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033741    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033744    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033748    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033752    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033755    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033758    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033761    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033763    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033766    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033769    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033772    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033775    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033777    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033780    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 12:09:57.365750 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033782    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033785    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033787    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033790    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033793    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033796    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033804    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033807    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033809    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033812    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033816    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033819    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033822    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033825    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033828    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033831    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033834    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033836    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033839    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 12:09:57.366796 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033842    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033844    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033847    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033849    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033852    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033854    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033857    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033860    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033862    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033865    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033867    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033870    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033872    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033875    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033877    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033881    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033886    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033889    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033892    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 12:09:57.367417 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033894    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033904    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033908    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033910    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033913    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033915    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033917    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033920    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033923    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033926    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033928    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033931    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033933    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033936    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033938    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033941    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033943    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033946    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033948    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033951    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 12:09:57.368395 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033953    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033956    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033958    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033961    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033963    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033965    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033968    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033970    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033973    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033979    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033981    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033984    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033987    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033989    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.033997    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034000    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034003    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 12:09:57.369023 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034015    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.034020    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034181    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034186    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034189    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034191    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034194    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034196    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034199    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034202    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034205    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034207    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034210    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034213    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034215    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 12:09:57.369530 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034218    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034220    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034223    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034225    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034228    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034230    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034232    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034235    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034237    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034240    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034245    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034248    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034250    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034253    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034255    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034265    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034269    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034271    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034274    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 12:09:57.468923 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034276    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034279    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034282    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034284    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034287    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034289    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034292    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034294    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034297    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034299    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034302    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034304    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034307    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034309    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034312    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034314    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034317    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034319    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034322    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034324    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 12:09:57.469882 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034327    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034329    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034332    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034337    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034340    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034343    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034345    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034348    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034352    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034361    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034364    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034367    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034369    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034372    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034375    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034378    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034380    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034383    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034385    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 12:09:57.471863 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034387    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034390    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034393    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034395    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034399    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034402    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034405    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034408    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034411    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034414    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034416    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034419    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034421    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034424    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034426    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034429    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034434    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034436    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034439    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 12:09:57.472716 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034441    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034444    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034446    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034449    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034458    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034461    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034464    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034466    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:57.034488    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.034494    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.034628    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.036764    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.038032    2570 server.go:1019] "Starting client certificate rotation"
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.038129    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 12:09:57.473994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.038159    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 12:09:57.474838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.040378    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 12:09:57.474838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.046010    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 12:09:57.474838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.057915    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 23 12:09:57.474838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.061056    2570 log.go:25] "Validated CRI v1 image API"
Jul 23 12:09:57.474838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.061979    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 12:09:57.474838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.064073    2570 fs.go:135] Filesystem UUIDs: map[49310041-42f9-469d-a816-a33cec022761:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b1641ae1-8a7d-4996-8cb3-b85242bbe57d:/dev/nvme0n1p4]
Jul 23 12:09:57.474838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.064089    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.068790    2570 manager.go:216] Machine: {Timestamp:2026-07-23 12:09:57.067693067 +0000 UTC m=+0.297809783 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096383 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e6421a977f59532518fb9434ea72f SystemUUID:ec2e6421-a977-f595-3251-8fb9434ea72f BootID:295d4361-4b53-4ddb-b9a2-732c4770960b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:76:4b:ae:90:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:76:4b:ae:90:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:65:66:1e:90:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.068888    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.068990    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.069119    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.071668    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.071689    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.072348    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.072356    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.072364    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.073451    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.074760    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.078572    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.078832    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.078864    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.078874    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.078888    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 12:09:57.475479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.078897    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.078906    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.079209    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.079224    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.080985    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.082801    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.082828    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.083929    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.083945    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.083951    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.083958    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.083967    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.083972    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.083980    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.083987    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.083996    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.084002    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.084011    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.084015    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.085309    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.085325    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.088614    2570 server.go:1268] "Started kubelet"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.088857    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.088908    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.089026    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.092913    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.095100    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.095126    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.096537    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r8bfb"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.096755    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.096796    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.096988    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.096605    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-105.ec2.internal.18c4e9f67587520f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-105.ec2.internal,UID:ip-10-0-133-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-105.ec2.internal,},FirstTimestamp:2026-07-23 12:09:57.088588303 +0000 UTC m=+0.318705019,LastTimestamp:2026-07-23 12:09:57.088588303 +0000 UTC m=+0.318705019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-105.ec2.internal,}"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.101069    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.101082    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.101174    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-105.ec2.internal\" not found"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.101769    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.101775    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.101792    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.101864    2570 factory.go:55] Registering systemd factory
Jul 23 12:09:57.476089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.101878    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.101930    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.101938    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.102116    2570 factory.go:153] Registering CRI-O factory
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.102126    2570 factory.go:223] Registration of the crio container factory successfully
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.102165    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.102187    2570 factory.go:103] Registering Raw factory
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.102198    2570 manager.go:1196] Started watching for new ooms in manager
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.102638    2570 manager.go:349] Starting recovery of all containers
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.104622    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r8bfb"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.104658    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.104748    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.111697    2570 manager.go:354] Recovery completed
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.116943    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.118638    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.118661    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.118670    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientPID"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.119155    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.119165    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.119182    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.119196    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.119765    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.119786    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.119794    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientPID"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.121127    2570 policy_none.go:49] "None policy: Start"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.121139    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.121148    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.123103    2570 policy_none.go:47] "Start"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.175990    2570 manager.go:337] "Starting Device Plugin manager"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.176020    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.176029    2570 server.go:87] "Starting device plugin registration server"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.176272    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.176284    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.176383    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.176466    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.176495    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.177044    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.177097    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-105.ec2.internal\" not found"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.261494    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.262710    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.262749    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.262778    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.262818    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.265867    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.277160    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.278075    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.278107    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 12:09:57.478023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.278120    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientPID"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.278148    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.291276    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.291295    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-105.ec2.internal\": node \"ip-10-0-133-105.ec2.internal\" not found"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.343365    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-105.ec2.internal\" not found"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.363726    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal"]
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.363806    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.365675    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.365705    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.365718    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientPID"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.367896    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.368010    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.368042    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.370388    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.370407    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.370416    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientPID"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.370429    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.370457    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.370467    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientPID"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.372653    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.372689    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.374653    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.374677    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.374689    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeHasSufficientPID"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.394225    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-105.ec2.internal\" not found" node="ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.399919    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-105.ec2.internal\" not found" node="ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.404137    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a8a00ddbb4637bc24d59460275cb167-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal\" (UID: \"7a8a00ddbb4637bc24d59460275cb167\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.404159    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8a00ddbb4637bc24d59460275cb167-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal\" (UID: \"7a8a00ddbb4637bc24d59460275cb167\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.404194    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4e9942b1aad18340678b6e6d4966a0e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-105.ec2.internal\" (UID: \"e4e9942b1aad18340678b6e6d4966a0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.479341 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.443777    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-105.ec2.internal\" not found"
Jul 23 12:09:57.643987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.504417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4e9942b1aad18340678b6e6d4966a0e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-105.ec2.internal\" (UID: \"e4e9942b1aad18340678b6e6d4966a0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.643987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.504448    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a8a00ddbb4637bc24d59460275cb167-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal\" (UID: \"7a8a00ddbb4637bc24d59460275cb167\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.643987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.504465    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8a00ddbb4637bc24d59460275cb167-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal\" (UID: \"7a8a00ddbb4637bc24d59460275cb167\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.643987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.504505    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4e9942b1aad18340678b6e6d4966a0e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-105.ec2.internal\" (UID: \"e4e9942b1aad18340678b6e6d4966a0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.643987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.504524    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a8a00ddbb4637bc24d59460275cb167-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal\" (UID: \"7a8a00ddbb4637bc24d59460275cb167\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.643987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.504521    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8a00ddbb4637bc24d59460275cb167-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal\" (UID: \"7a8a00ddbb4637bc24d59460275cb167\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.643987 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.544660    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-105.ec2.internal\" not found"
Jul 23 12:09:57.646213 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.645371    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-105.ec2.internal\" not found"
Jul 23 12:09:57.849633 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.698567    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.849633 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.703018    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:57.849633 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.745818    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-105.ec2.internal\" not found"
Jul 23 12:09:57.849633 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:57.846435    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-105.ec2.internal\" not found"
Jul 23 12:09:59.508178 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:57.913808    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 12:09:59.508178 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.471009    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:59.508178 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.484727    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 12:09:59.508178 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.486170    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal"
Jul 23 12:09:59.508178 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.496776    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 12:09:59.508178 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.506976    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 12:09:59.508178 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.507113    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 12:09:59.508178 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.507116    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.548167    2570 apiserver.go:52] "Watching apiserver"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.564927    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.567913    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nhxhc","kube-system/konnectivity-agent-4jmxz","openshift-cluster-node-tuning-operator/tuned-nkl87","openshift-image-registry/node-ca-h4dhk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal","openshift-multus/multus-additional-cni-plugins-hcc2t","openshift-multus/network-metrics-daemon-cnjvr","openshift-network-diagnostics/network-check-target-dqxkg","kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9","openshift-dns/node-resolver-kc8fn","openshift-multus/multus-jj2ss","openshift-network-operator/iptables-alerter-b5vm4","openshift-ovn-kubernetes/ovnkube-node-992xp"]
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.570430    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.570457    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.570561    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.572882    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.574971    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.575101    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.575120    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5gvz5\""
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.575195    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.576571    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58t76\" (UniqueName: \"kubernetes.io/projected/26244712-6672-4444-b78f-55028760ff77-kube-api-access-58t76\") pod \"node-resolver-kc8fn\" (UID: \"26244712-6672-4444-b78f-55028760ff77\") " pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.576594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.576612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb9hf\" (UniqueName: \"kubernetes.io/projected/5245d445-4d3c-4f7d-94ea-c11197612fc9-kube-api-access-sb9hf\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.576636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26244712-6672-4444-b78f-55028760ff77-hosts-file\") pod \"node-resolver-kc8fn\" (UID: \"26244712-6672-4444-b78f-55028760ff77\") " pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.576657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26244712-6672-4444-b78f-55028760ff77-tmp-dir\") pod \"node-resolver-kc8fn\" (UID: \"26244712-6672-4444-b78f-55028760ff77\") " pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.577093    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.577109    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.577444    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.577495    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jzs64\""
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.579364    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.579933    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-67r85\""
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.581102    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.581236    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.581515    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 12:04:58 +0000 UTC" deadline="2028-03-01 03:38:14.912596144 +0000 UTC"
Jul 23 12:09:59.635781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.581548    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14079h28m15.331051455s"
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.581715    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.582220    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.582702    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.582742    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.582785    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.582852    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.583057    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.583078    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.583111    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.583191    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dphzz\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.584618    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.584661    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.584974    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bnwb8\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.585190    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.585214    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.585230    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.585233    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.585278    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.586365    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.588566    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zk7gx\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.588604    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.588622    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.588682    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.589019    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.590864    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.591203    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5v6nm\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.591659    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.591791    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.593895    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.593923    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.593928    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.594003    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sjpkj\""
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.594528    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:09:59.637452 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.594585    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:09:59.638962 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.596775    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.638962 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.598652    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 12:09:59.638962 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.598866    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sqjlk\""
Jul 23 12:09:59.638962 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.602782    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-75lvz"
Jul 23 12:09:59.638962 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.616124    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-75lvz"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.672387    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677282    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-cni-bin\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677298    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-sys-fs\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677313    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-var-lib-cni-bin\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-var-lib-kubelet\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-cnibin\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.677440    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677495    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-systemd-units\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.677520    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs podName:5245d445-4d3c-4f7d-94ea-c11197612fc9 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:00.177503342 +0000 UTC m=+1.938622689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs") pod "network-metrics-daemon-cnjvr" (UID: "5245d445-4d3c-4f7d-94ea-c11197612fc9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-lib-modules\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677575    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3345a010-fc76-421e-a39a-2849a259d701-host-slash\") pod \"iptables-alerter-b5vm4\" (UID: \"3345a010-fc76-421e-a39a-2849a259d701\") " pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677605    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-cni-dir\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677620    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-sysctl-conf\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-run-systemd\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.756792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-log-socket\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677684    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-run-multus-certs\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677706    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58t76\" (UniqueName: \"kubernetes.io/projected/26244712-6672-4444-b78f-55028760ff77-kube-api-access-58t76\") pod \"node-resolver-kc8fn\" (UID: \"26244712-6672-4444-b78f-55028760ff77\") " pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-run-netns\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677739    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-cni-netd\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677755    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-registration-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-os-release\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-run-openvswitch\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677928    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-run-ovn-kubernetes\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677948    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b38bd05-2ec3-4078-82eb-00b3d5d6d688-serviceca\") pod \"node-ca-h4dhk\" (UID: \"2b38bd05-2ec3-4078-82eb-00b3d5d6d688\") " pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-run-k8s-cni-cncf-io\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.677993    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3799a08-74cf-4334-824f-bc50ca6558c4-tmp\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-kubelet\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678038    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa7e528-7695-4a0e-a325-956ff07acf09-dbus\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678062    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-kubernetes\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.759863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678083    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-tuned\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678104    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-socket-dir-parent\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678135    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-run-netns\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-var-lib-kubelet\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678173    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-hostroot\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678192    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-run\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678226    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-sys\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678244    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-var-lib-openvswitch\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678261    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/382af20d-20ca-4052-9c89-041dac32a6be-ovn-node-metrics-cert\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2pr5\" (UniqueName: \"kubernetes.io/projected/382af20d-20ca-4052-9c89-041dac32a6be-kube-api-access-d2pr5\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678307    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-device-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678363    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-sysctl-d\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-systemd\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678419    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-node-log\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.760700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678440    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678480    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-system-cni-dir\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678506    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-etc-kubernetes\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678528    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-sysconfig\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678549    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-cnibin\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678570    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-os-release\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678589    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa7e528-7695-4a0e-a325-956ff07acf09-kubelet-config\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678649    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq5mf\" (UniqueName: \"kubernetes.io/projected/3345a010-fc76-421e-a39a-2849a259d701-kube-api-access-xq5mf\") pod \"iptables-alerter-b5vm4\" (UID: \"3345a010-fc76-421e-a39a-2849a259d701\") " pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678671    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/252ff8de-6507-4855-adda-acef49b9eec4-agent-certs\") pod \"konnectivity-agent-4jmxz\" (UID: \"252ff8de-6507-4855-adda-acef49b9eec4\") " pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/252ff8de-6507-4855-adda-acef49b9eec4-konnectivity-ca\") pod \"konnectivity-agent-4jmxz\" (UID: \"252ff8de-6507-4855-adda-acef49b9eec4\") " pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678718    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-conf-dir\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678736    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-modprobe-d\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/382af20d-20ca-4052-9c89-041dac32a6be-env-overrides\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678780    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-system-cni-dir\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b38bd05-2ec3-4078-82eb-00b3d5d6d688-host\") pod \"node-ca-h4dhk\" (UID: \"2b38bd05-2ec3-4078-82eb-00b3d5d6d688\") " pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.763765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-var-lib-cni-multus\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678822    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-host\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-run-ovn\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/382af20d-20ca-4052-9c89-041dac32a6be-ovnkube-script-lib\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678873    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhkt5\" (UniqueName: \"kubernetes.io/projected/2b38bd05-2ec3-4078-82eb-00b3d5d6d688-kube-api-access-qhkt5\") pod \"node-ca-h4dhk\" (UID: \"2b38bd05-2ec3-4078-82eb-00b3d5d6d688\") " pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdzrk\" (UniqueName: \"kubernetes.io/projected/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-kube-api-access-hdzrk\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26244712-6672-4444-b78f-55028760ff77-hosts-file\") pod \"node-resolver-kc8fn\" (UID: \"26244712-6672-4444-b78f-55028760ff77\") " pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/382af20d-20ca-4052-9c89-041dac32a6be-ovnkube-config\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.678960    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26244712-6672-4444-b78f-55028760ff77-hosts-file\") pod \"node-resolver-kc8fn\" (UID: \"26244712-6672-4444-b78f-55028760ff77\") " pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679395    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679415    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-daemon-config\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679431    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-slash\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb9hf\" (UniqueName: \"kubernetes.io/projected/5245d445-4d3c-4f7d-94ea-c11197612fc9-kube-api-access-sb9hf\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679482    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7gk8\" (UniqueName: \"kubernetes.io/projected/c3799a08-74cf-4334-824f-bc50ca6558c4-kube-api-access-n7gk8\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679506    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679522    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmm7g\" (UniqueName: \"kubernetes.io/projected/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-kube-api-access-zmm7g\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.764571 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679549    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3345a010-fc76-421e-a39a-2849a259d701-iptables-alerter-script\") pod \"iptables-alerter-b5vm4\" (UID: \"3345a010-fc76-421e-a39a-2849a259d701\") " pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26244712-6672-4444-b78f-55028760ff77-tmp-dir\") pod \"node-resolver-kc8fn\" (UID: \"26244712-6672-4444-b78f-55028760ff77\") " pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679586    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-etc-openvswitch\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679599    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-socket-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mclk\" (UniqueName: \"kubernetes.io/projected/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-kube-api-access-9mclk\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.679626    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-cni-binary-copy\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.683072    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26244712-6672-4444-b78f-55028760ff77-tmp-dir\") pod \"node-resolver-kc8fn\" (UID: \"26244712-6672-4444-b78f-55028760ff77\") " pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.684845    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.688350    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb9hf\" (UniqueName: \"kubernetes.io/projected/5245d445-4d3c-4f7d-94ea-c11197612fc9-kube-api-access-sb9hf\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.688403    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58t76\" (UniqueName: \"kubernetes.io/projected/26244712-6672-4444-b78f-55028760ff77-kube-api-access-58t76\") pod \"node-resolver-kc8fn\" (UID: \"26244712-6672-4444-b78f-55028760ff77\") " pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.766838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.708805    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-cnibin\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780069    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-os-release\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780085    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa7e528-7695-4a0e-a325-956ff07acf09-kubelet-config\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780109    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq5mf\" (UniqueName: \"kubernetes.io/projected/3345a010-fc76-421e-a39a-2849a259d701-kube-api-access-xq5mf\") pod \"iptables-alerter-b5vm4\" (UID: \"3345a010-fc76-421e-a39a-2849a259d701\") " pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780145    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/252ff8de-6507-4855-adda-acef49b9eec4-agent-certs\") pod \"konnectivity-agent-4jmxz\" (UID: \"252ff8de-6507-4855-adda-acef49b9eec4\") " pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780167    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/252ff8de-6507-4855-adda-acef49b9eec4-konnectivity-ca\") pod \"konnectivity-agent-4jmxz\" (UID: \"252ff8de-6507-4855-adda-acef49b9eec4\") " pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780146    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-cnibin\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-conf-dir\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780213    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-modprobe-d\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780239    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-os-release\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780240    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780263    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-conf-dir\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780283    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780290    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/382af20d-20ca-4052-9c89-041dac32a6be-env-overrides\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780207    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa7e528-7695-4a0e-a325-956ff07acf09-kubelet-config\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-system-cni-dir\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.845678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780346    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b38bd05-2ec3-4078-82eb-00b3d5d6d688-host\") pod \"node-ca-h4dhk\" (UID: \"2b38bd05-2ec3-4078-82eb-00b3d5d6d688\") " pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780370    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-var-lib-cni-multus\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780380    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-modprobe-d\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780392    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-host\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780428    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b38bd05-2ec3-4078-82eb-00b3d5d6d688-host\") pod \"node-ca-h4dhk\" (UID: \"2b38bd05-2ec3-4078-82eb-00b3d5d6d688\") " pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780442    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-var-lib-cni-multus\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780452    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-host\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780485    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-system-cni-dir\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-run-ovn\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780554    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/382af20d-20ca-4052-9c89-041dac32a6be-ovnkube-script-lib\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780579    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhkt5\" (UniqueName: \"kubernetes.io/projected/2b38bd05-2ec3-4078-82eb-00b3d5d6d688-kube-api-access-qhkt5\") pod \"node-ca-h4dhk\" (UID: \"2b38bd05-2ec3-4078-82eb-00b3d5d6d688\") " pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780602    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdzrk\" (UniqueName: \"kubernetes.io/projected/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-kube-api-access-hdzrk\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/382af20d-20ca-4052-9c89-041dac32a6be-ovnkube-config\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780633    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-run-ovn\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780660    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/382af20d-20ca-4052-9c89-041dac32a6be-env-overrides\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780706    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-daemon-config\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780768    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-slash\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780824    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7gk8\" (UniqueName: \"kubernetes.io/projected/c3799a08-74cf-4334-824f-bc50ca6558c4-kube-api-access-n7gk8\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780886    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmm7g\" (UniqueName: \"kubernetes.io/projected/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-kube-api-access-zmm7g\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780931    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780959    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3345a010-fc76-421e-a39a-2849a259d701-iptables-alerter-script\") pod \"iptables-alerter-b5vm4\" (UID: \"3345a010-fc76-421e-a39a-2849a259d701\") " pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781003    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-etc-openvswitch\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-socket-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.780736    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/252ff8de-6507-4855-adda-acef49b9eec4-konnectivity-ca\") pod \"konnectivity-agent-4jmxz\" (UID: \"252ff8de-6507-4855-adda-acef49b9eec4\") " pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781262    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-daemon-config\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781357    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/382af20d-20ca-4052-9c89-041dac32a6be-ovnkube-config\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781338    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mclk\" (UniqueName: \"kubernetes.io/projected/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-kube-api-access-9mclk\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781387    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781397    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-slash\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781420    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-cni-binary-copy\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781531    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-etc-openvswitch\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781527    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-cni-bin\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-sys-fs\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.848669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-var-lib-cni-bin\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781632    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-var-lib-kubelet\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781657    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-socket-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-cnibin\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-systemd-units\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781703    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-var-lib-cni-bin\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781740    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-lib-modules\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781755    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-cnibin\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781765    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781789    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3345a010-fc76-421e-a39a-2849a259d701-host-slash\") pod \"iptables-alerter-b5vm4\" (UID: \"3345a010-fc76-421e-a39a-2849a259d701\") " pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781800    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-var-lib-kubelet\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-cni-dir\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-sysctl-conf\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-sys-fs\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-run-systemd\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781908    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/382af20d-20ca-4052-9c89-041dac32a6be-ovnkube-script-lib\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781917    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-log-socket\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781922    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-run-systemd\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.850948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3345a010-fc76-421e-a39a-2849a259d701-host-slash\") pod \"iptables-alerter-b5vm4\" (UID: \"3345a010-fc76-421e-a39a-2849a259d701\") " pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.781993    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-systemd-units\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782017    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-cni-dir\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-run-multus-certs\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782033    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3345a010-fc76-421e-a39a-2849a259d701-iptables-alerter-script\") pod \"iptables-alerter-b5vm4\" (UID: \"3345a010-fc76-421e-a39a-2849a259d701\") " pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782046    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-cni-binary-copy\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782053    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-log-socket\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782036    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-sysctl-conf\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-run-netns\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782091    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-cni-bin\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-lib-modules\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.782119    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782154    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-cni-netd\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782174    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-cni-netd\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782185    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-run-multus-certs\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.782214    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret podName:2fa7e528-7695-4a0e-a325-956ff07acf09 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:00.282196321 +0000 UTC m=+2.043315663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret") pod "global-pull-secret-syncer-nhxhc" (UID: "2fa7e528-7695-4a0e-a325-956ff07acf09") : object "kube-system"/"original-pull-secret" not registered
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.851585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782228    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-run-netns\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782266    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-registration-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782300    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-os-release\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782329    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-run-openvswitch\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-registration-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782356    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-run-ovn-kubernetes\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782352    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-os-release\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782378    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-run-openvswitch\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782407    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b38bd05-2ec3-4078-82eb-00b3d5d6d688-serviceca\") pod \"node-ca-h4dhk\" (UID: \"2b38bd05-2ec3-4078-82eb-00b3d5d6d688\") " pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782422    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-run-ovn-kubernetes\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782427    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-run-k8s-cni-cncf-io\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-run-k8s-cni-cncf-io\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3799a08-74cf-4334-824f-bc50ca6558c4-tmp\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-kubelet\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782540    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa7e528-7695-4a0e-a325-956ff07acf09-dbus\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:09:59.961497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782580    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-host-kubelet\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-kubernetes\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-tuned\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782676    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-socket-dir-parent\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782685    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa7e528-7695-4a0e-a325-956ff07acf09-dbus\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782698    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-run-netns\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-var-lib-kubelet\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782756    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-multus-socket-dir-parent\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782762    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-hostroot\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782773    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-run-netns\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782796    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-run\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782813    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-hostroot\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782834    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-kubernetes\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782839    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-sys\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782868    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-var-lib-openvswitch\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782882    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b38bd05-2ec3-4078-82eb-00b3d5d6d688-serviceca\") pod \"node-ca-h4dhk\" (UID: \"2b38bd05-2ec3-4078-82eb-00b3d5d6d688\") " pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782898    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-sys\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-run\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.962909 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/382af20d-20ca-4052-9c89-041dac32a6be-ovn-node-metrics-cert\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782945    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-var-lib-openvswitch\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2pr5\" (UniqueName: \"kubernetes.io/projected/382af20d-20ca-4052-9c89-041dac32a6be-kube-api-access-d2pr5\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782984    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.782951    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-host-var-lib-kubelet\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-device-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783075    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783087    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-sysctl-d\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783109    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-systemd\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783133    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-node-log\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783137    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/252ff8de-6507-4855-adda-acef49b9eec4-agent-certs\") pod \"konnectivity-agent-4jmxz\" (UID: \"252ff8de-6507-4855-adda-acef49b9eec4\") " pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783137    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-device-dir\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-system-cni-dir\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-sysctl-d\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-etc-kubernetes\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.963953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-sysconfig\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783260    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/382af20d-20ca-4052-9c89-041dac32a6be-node-log\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783201    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-systemd\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783293    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-system-cni-dir\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783318    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-etc-kubernetes\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783321    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-sysconfig\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.783653    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.784914    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/382af20d-20ca-4052-9c89-041dac32a6be-ovn-node-metrics-cert\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.785101    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3799a08-74cf-4334-824f-bc50ca6558c4-etc-tuned\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.785211    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3799a08-74cf-4334-824f-bc50ca6558c4-tmp\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.788586    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.788605    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.788614    2570 projected.go:196] Error preparing data for projected volume kube-api-access-gs577 for pod openshift-network-diagnostics/network-check-target-dqxkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:09:59.788662    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577 podName:913714e7-afa4-4619-95ea-58ebf7a87df2 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:00.2886485 +0000 UTC m=+2.049767829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gs577" (UniqueName: "kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577") pod "network-check-target-dqxkg" (UID: "913714e7-afa4-4619-95ea-58ebf7a87df2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.789192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq5mf\" (UniqueName: \"kubernetes.io/projected/3345a010-fc76-421e-a39a-2849a259d701-kube-api-access-xq5mf\") pod \"iptables-alerter-b5vm4\" (UID: \"3345a010-fc76-421e-a39a-2849a259d701\") " pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.791712    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdzrk\" (UniqueName: \"kubernetes.io/projected/3ab2fce7-83a4-4712-bf18-a1bb14321a3e-kube-api-access-hdzrk\") pod \"multus-jj2ss\" (UID: \"3ab2fce7-83a4-4712-bf18-a1bb14321a3e\") " pod="openshift-multus/multus-jj2ss"
Jul 23 12:09:59.965053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.792027    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7gk8\" (UniqueName: \"kubernetes.io/projected/c3799a08-74cf-4334-824f-bc50ca6558c4-kube-api-access-n7gk8\") pod \"tuned-nkl87\" (UID: \"c3799a08-74cf-4334-824f-bc50ca6558c4\") " pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.792343    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmm7g\" (UniqueName: \"kubernetes.io/projected/52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849-kube-api-access-zmm7g\") pod \"multus-additional-cni-plugins-hcc2t\" (UID: \"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849\") " pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.792379    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhkt5\" (UniqueName: \"kubernetes.io/projected/2b38bd05-2ec3-4078-82eb-00b3d5d6d688-kube-api-access-qhkt5\") pod \"node-ca-h4dhk\" (UID: \"2b38bd05-2ec3-4078-82eb-00b3d5d6d688\") " pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.792732    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mclk\" (UniqueName: \"kubernetes.io/projected/13c93698-28f6-4597-92c3-7b2e3fe6cfa9-kube-api-access-9mclk\") pod \"aws-ebs-csi-driver-node-rpmp9\" (UID: \"13c93698-28f6-4597-92c3-7b2e3fe6cfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.793038    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2pr5\" (UniqueName: \"kubernetes.io/projected/382af20d-20ca-4052-9c89-041dac32a6be-kube-api-access-d2pr5\") pod \"ovnkube-node-992xp\" (UID: \"382af20d-20ca-4052-9c89-041dac32a6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.906786    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kc8fn"
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.926520    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nkl87"
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:59.948352    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3799a08_74cf_4334_824f_bc50ca6558c4.slice/crio-1f5be9efadc42bcb68a387aff31b2fee5b38d7effa10c9a44466178b19714449 WatchSource:0}: Error finding container 1f5be9efadc42bcb68a387aff31b2fee5b38d7effa10c9a44466178b19714449: Status 404 returned error can't find the container with id 1f5be9efadc42bcb68a387aff31b2fee5b38d7effa10c9a44466178b19714449
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:59.948575    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26244712_6672_4444_b78f_55028760ff77.slice/crio-52994527a0d6607c60691b28c9cba3d1d748f49c6584c6c9e2f2ce564efcda8d WatchSource:0}: Error finding container 52994527a0d6607c60691b28c9cba3d1d748f49c6584c6c9e2f2ce564efcda8d: Status 404 returned error can't find the container with id 52994527a0d6607c60691b28c9cba3d1d748f49c6584c6c9e2f2ce564efcda8d
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:59.948835    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8a00ddbb4637bc24d59460275cb167.slice/crio-d31fa5fe23688ab4140b826ec474e0e034b49165ffca4def6822ea1450a02074 WatchSource:0}: Error finding container d31fa5fe23688ab4140b826ec474e0e034b49165ffca4def6822ea1450a02074: Status 404 returned error can't find the container with id d31fa5fe23688ab4140b826ec474e0e034b49165ffca4def6822ea1450a02074
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.950638    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h4dhk"
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.961039    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 12:09:59.966061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.966010    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:09:59.979836 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:59.979813    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b38bd05_2ec3_4078_82eb_00b3d5d6d688.slice/crio-8407f895e0804fbbf1e0d5bcfd8a17a789535b7ece87e0c2c871ed7731c714aa WatchSource:0}: Error finding container 8407f895e0804fbbf1e0d5bcfd8a17a789535b7ece87e0c2c871ed7731c714aa: Status 404 returned error can't find the container with id 8407f895e0804fbbf1e0d5bcfd8a17a789535b7ece87e0c2c871ed7731c714aa
Jul 23 12:09:59.989481 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.989448    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcc2t"
Jul 23 12:09:59.997887 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:09:59.997866    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ff6ab8_1ad4_4d2f_a6ea_b6fe1ec03849.slice/crio-369156900fade85589888ab0add7a060a588fdb0e26075e9d4730a1842f31359 WatchSource:0}: Error finding container 369156900fade85589888ab0add7a060a588fdb0e26075e9d4730a1842f31359: Status 404 returned error can't find the container with id 369156900fade85589888ab0add7a060a588fdb0e26075e9d4730a1842f31359
Jul 23 12:09:59.998664 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:09:59.998648    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b5vm4"
Jul 23 12:10:00.011203 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:10:00.011147    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3345a010_fc76_421e_a39a_2849a259d701.slice/crio-227284b5b8d3bc06574a80c8aa2fd7142157d9604839903eb5933f4d10be32ce WatchSource:0}: Error finding container 227284b5b8d3bc06574a80c8aa2fd7142157d9604839903eb5933f4d10be32ce: Status 404 returned error can't find the container with id 227284b5b8d3bc06574a80c8aa2fd7142157d9604839903eb5933f4d10be32ce
Jul 23 12:10:00.025939 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.025916    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:10:00.033505 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:10:00.033484    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252ff8de_6507_4855_adda_acef49b9eec4.slice/crio-b6a318639ba9300af001e635630428ceca775119c6cb8bf75274a39b786ff08a WatchSource:0}: Error finding container b6a318639ba9300af001e635630428ceca775119c6cb8bf75274a39b786ff08a: Status 404 returned error can't find the container with id b6a318639ba9300af001e635630428ceca775119c6cb8bf75274a39b786ff08a
Jul 23 12:10:00.060948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.060924    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9"
Jul 23 12:10:00.066767 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.066749    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jj2ss"
Jul 23 12:10:00.074204 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:10:00.074184    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab2fce7_83a4_4712_bf18_a1bb14321a3e.slice/crio-8bcb46488ecdaef43e412180e3085ccdc568a0abd57c370a1e54b1bb7de73d16 WatchSource:0}: Error finding container 8bcb46488ecdaef43e412180e3085ccdc568a0abd57c370a1e54b1bb7de73d16: Status 404 returned error can't find the container with id 8bcb46488ecdaef43e412180e3085ccdc568a0abd57c370a1e54b1bb7de73d16
Jul 23 12:10:00.075823 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:10:00.075803    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c93698_28f6_4597_92c3_7b2e3fe6cfa9.slice/crio-a958883dcb33c27c575d068ec92bcb3b4ed51374cb1009fc0af525c447c6c6d7 WatchSource:0}: Error finding container a958883dcb33c27c575d068ec92bcb3b4ed51374cb1009fc0af525c447c6c6d7: Status 404 returned error can't find the container with id a958883dcb33c27c575d068ec92bcb3b4ed51374cb1009fc0af525c447c6c6d7
Jul 23 12:10:00.077346 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.077331    2570 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-driver start failed in pod aws-ebs-csi-driver-node-rpmp9_openshift-cluster-csi-drivers(13c93698-28f6-4597-92c3-7b2e3fe6cfa9): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 23 12:10:00.077995 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.077978    2570 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-node-driver-registrar start failed in pod aws-ebs-csi-driver-node-rpmp9_openshift-cluster-csi-drivers(13c93698-28f6-4597-92c3-7b2e3fe6cfa9): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 23 12:10:00.079750 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.079735    2570 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-liveness-probe start failed in pod aws-ebs-csi-driver-node-rpmp9_openshift-cluster-csi-drivers(13c93698-28f6-4597-92c3-7b2e3fe6cfa9): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 23 12:10:00.079801 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.079769    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9" podUID="13c93698-28f6-4597-92c3-7b2e3fe6cfa9"
Jul 23 12:10:00.099394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.099367    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 12:10:00.184812 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.184782    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:00.184959 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.184904    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:00.184959 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.184952    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs podName:5245d445-4d3c-4f7d-94ea-c11197612fc9 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:01.184939283 +0000 UTC m=+2.946058613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs") pod "network-metrics-daemon-cnjvr" (UID: "5245d445-4d3c-4f7d-94ea-c11197612fc9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:00.286082 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.286002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:00.286219 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.286104    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:00.286219 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.286156    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret podName:2fa7e528-7695-4a0e-a325-956ff07acf09 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:01.286143338 +0000 UTC m=+3.047262666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret") pod "global-pull-secret-syncer-nhxhc" (UID: "2fa7e528-7695-4a0e-a325-956ff07acf09") : object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:00.386994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.386958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:00.387173 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.387141    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 12:10:00.387173 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.387163    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 12:10:00.387284 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.387175    2570 projected.go:196] Error preparing data for projected volume kube-api-access-gs577 for pod openshift-network-diagnostics/network-check-target-dqxkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:00.387284 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.387238    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577 podName:913714e7-afa4-4619-95ea-58ebf7a87df2 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:01.387219032 +0000 UTC m=+3.148338363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs577" (UniqueName: "kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577") pod "network-check-target-dqxkg" (UID: "913714e7-afa4-4619-95ea-58ebf7a87df2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:00.619140 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.619023    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 12:04:59 +0000 UTC" deadline="2028-04-28 12:34:30.175656558 +0000 UTC"
Jul 23 12:10:00.619140 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.619088    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15480h24m29.556572844s"
Jul 23 12:10:00.737519 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.735175    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:00.737519 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.735309    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:00.754762 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.754667    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h4dhk" event={"ID":"2b38bd05-2ec3-4078-82eb-00b3d5d6d688","Type":"ContainerStarted","Data":"8407f895e0804fbbf1e0d5bcfd8a17a789535b7ece87e0c2c871ed7731c714aa"}
Jul 23 12:10:00.765676 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.765605    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kc8fn" event={"ID":"26244712-6672-4444-b78f-55028760ff77","Type":"ContainerStarted","Data":"52994527a0d6607c60691b28c9cba3d1d748f49c6584c6c9e2f2ce564efcda8d"}
Jul 23 12:10:00.788626 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.788533    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal" event={"ID":"7a8a00ddbb4637bc24d59460275cb167","Type":"ContainerStarted","Data":"d31fa5fe23688ab4140b826ec474e0e034b49165ffca4def6822ea1450a02074"}
Jul 23 12:10:00.791723 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.791641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jj2ss" event={"ID":"3ab2fce7-83a4-4712-bf18-a1bb14321a3e","Type":"ContainerStarted","Data":"8bcb46488ecdaef43e412180e3085ccdc568a0abd57c370a1e54b1bb7de73d16"}
Jul 23 12:10:00.831231 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.831196    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9" event={"ID":"13c93698-28f6-4597-92c3-7b2e3fe6cfa9","Type":"ContainerStarted","Data":"a958883dcb33c27c575d068ec92bcb3b4ed51374cb1009fc0af525c447c6c6d7"}
Jul 23 12:10:00.841305 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:00.841228    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b13e6eb321323c63d8808dd2edd629ec9e6bb50a1f51642a22e1192625d06647\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a241c7873dcd9a33c18e22c17fc2266c2eba1ed07e551f8eb9e60ee375ef576a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0409c7725f34b67762c9af07735a2803f1edbba13924022918025dff1863c18c\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9" podUID="13c93698-28f6-4597-92c3-7b2e3fe6cfa9"
Jul 23 12:10:00.843539 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.843443    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" event={"ID":"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849","Type":"ContainerStarted","Data":"369156900fade85589888ab0add7a060a588fdb0e26075e9d4730a1842f31359"}
Jul 23 12:10:00.856544 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.856510    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" event={"ID":"382af20d-20ca-4052-9c89-041dac32a6be","Type":"ContainerStarted","Data":"002b23e909bf4b593b667a6b427bf5b9f8b42fdb2faca798b7a1b9597eee94fc"}
Jul 23 12:10:00.867831 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.867801    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal" event={"ID":"e4e9942b1aad18340678b6e6d4966a0e","Type":"ContainerStarted","Data":"ffd23e1acca12c6881444dd0e64cc4a6cffcd6778faa0bb0baa0f52ec4026eea"}
Jul 23 12:10:00.883299 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.883225    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nkl87" event={"ID":"c3799a08-74cf-4334-824f-bc50ca6558c4","Type":"ContainerStarted","Data":"1f5be9efadc42bcb68a387aff31b2fee5b38d7effa10c9a44466178b19714449"}
Jul 23 12:10:00.898319 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.898204    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jmxz" event={"ID":"252ff8de-6507-4855-adda-acef49b9eec4","Type":"ContainerStarted","Data":"b6a318639ba9300af001e635630428ceca775119c6cb8bf75274a39b786ff08a"}
Jul 23 12:10:00.919114 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.919085    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b5vm4" event={"ID":"3345a010-fc76-421e-a39a-2849a259d701","Type":"ContainerStarted","Data":"227284b5b8d3bc06574a80c8aa2fd7142157d9604839903eb5933f4d10be32ce"}
Jul 23 12:10:00.955361 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:00.955286    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 12:10:01.206708 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:01.206630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:01.206876 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.206763    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:01.206876 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.206833    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs podName:5245d445-4d3c-4f7d-94ea-c11197612fc9 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:03.20681503 +0000 UTC m=+4.967934367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs") pod "network-metrics-daemon-cnjvr" (UID: "5245d445-4d3c-4f7d-94ea-c11197612fc9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:01.307844 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:01.307754    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:01.308067 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.307894    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:01.308067 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.307953    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret podName:2fa7e528-7695-4a0e-a325-956ff07acf09 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:03.307934349 +0000 UTC m=+5.069053681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret") pod "global-pull-secret-syncer-nhxhc" (UID: "2fa7e528-7695-4a0e-a325-956ff07acf09") : object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:01.408489 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:01.408441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:01.408677 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.408657    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 12:10:01.408749 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.408689    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 12:10:01.408749 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.408711    2570 projected.go:196] Error preparing data for projected volume kube-api-access-gs577 for pod openshift-network-diagnostics/network-check-target-dqxkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:01.408835 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.408771    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577 podName:913714e7-afa4-4619-95ea-58ebf7a87df2 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:03.408751992 +0000 UTC m=+5.169871324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs577" (UniqueName: "kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577") pod "network-check-target-dqxkg" (UID: "913714e7-afa4-4619-95ea-58ebf7a87df2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:01.619376 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:01.619293    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 12:04:59 +0000 UTC" deadline="2028-03-25 14:28:02.331206874 +0000 UTC"
Jul 23 12:10:01.619376 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:01.619328    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14666h18m0.711883296s"
Jul 23 12:10:01.732140 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:01.732113    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:01.732315 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.732249    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:01.732315 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:01.732268    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:01.732464 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:01.732434    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:01.971688 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:01.971376    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 12:10:02.738187 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:02.737566    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:02.738187 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:02.737752    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:03.223921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:03.223837    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:03.224071 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.224013    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:03.224071 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.224071    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs podName:5245d445-4d3c-4f7d-94ea-c11197612fc9 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:07.224053268 +0000 UTC m=+8.985172597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs") pod "network-metrics-daemon-cnjvr" (UID: "5245d445-4d3c-4f7d-94ea-c11197612fc9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:03.325285 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:03.324726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:03.325285 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.324892    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:03.325285 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.324954    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret podName:2fa7e528-7695-4a0e-a325-956ff07acf09 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:07.324933725 +0000 UTC m=+9.086053060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret") pod "global-pull-secret-syncer-nhxhc" (UID: "2fa7e528-7695-4a0e-a325-956ff07acf09") : object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:03.426029 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:03.425994    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:03.426185 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.426157    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 12:10:03.426185 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.426183    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 12:10:03.426306 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.426195    2570 projected.go:196] Error preparing data for projected volume kube-api-access-gs577 for pod openshift-network-diagnostics/network-check-target-dqxkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:03.426306 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.426259    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577 podName:913714e7-afa4-4619-95ea-58ebf7a87df2 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:07.426239714 +0000 UTC m=+9.187359047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs577" (UniqueName: "kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577") pod "network-check-target-dqxkg" (UID: "913714e7-afa4-4619-95ea-58ebf7a87df2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:03.732849 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:03.732778    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:03.733009 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.732918    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:03.733345 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:03.733327    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:03.733443 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:03.733423    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:04.732926 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:04.732879    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:04.733604 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:04.733012    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:05.732209 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:05.732180    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:05.732358 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:05.732295    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:05.732415 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:05.732350    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:05.732465 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:05.732446    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:06.732537 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:06.732501    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:06.732936 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:06.732646    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:07.255069 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:07.255037    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:07.255248 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.255182    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:07.255322 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.255256    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs podName:5245d445-4d3c-4f7d-94ea-c11197612fc9 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:15.255235876 +0000 UTC m=+17.016355206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs") pod "network-metrics-daemon-cnjvr" (UID: "5245d445-4d3c-4f7d-94ea-c11197612fc9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:07.356083 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:07.356044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:07.356267 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.356195    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:07.356331 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.356269    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret podName:2fa7e528-7695-4a0e-a325-956ff07acf09 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:15.35625134 +0000 UTC m=+17.117370672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret") pod "global-pull-secret-syncer-nhxhc" (UID: "2fa7e528-7695-4a0e-a325-956ff07acf09") : object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:07.457146 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:07.457109    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:07.457312 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.457262    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 12:10:07.457312 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.457286    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 12:10:07.457312 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.457301    2570 projected.go:196] Error preparing data for projected volume kube-api-access-gs577 for pod openshift-network-diagnostics/network-check-target-dqxkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:07.457562 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.457367    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577 podName:913714e7-afa4-4619-95ea-58ebf7a87df2 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:15.457347987 +0000 UTC m=+17.218467336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs577" (UniqueName: "kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577") pod "network-check-target-dqxkg" (UID: "913714e7-afa4-4619-95ea-58ebf7a87df2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:07.732845 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:07.732724    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:07.732845 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:07.732724    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:07.733422 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.732886    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:07.733422 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:07.733003    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:08.733406 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:08.733374    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:08.733858 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:08.733462    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:09.732363 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:09.732334    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:09.732563 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:09.732455    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:09.732563 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:09.732514    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:09.732681 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:09.732625    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:10.733181 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:10.732339    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:10.733181 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:10.732695    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:10.946635 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:10.946545    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" event={"ID":"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849","Type":"ContainerStarted","Data":"328cceb471f80ade7f98073dfaa90f90f1e480dfa5455e37a08f807c76fe0016"}
Jul 23 12:10:10.948186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:10.948159    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal" event={"ID":"e4e9942b1aad18340678b6e6d4966a0e","Type":"ContainerStarted","Data":"4cd0ddb7dea35f1f49f5563b1a9e25ed6faa8326c75c4d79fed115d2b0388c29"}
Jul 23 12:10:10.949663 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:10.949640    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nkl87" event={"ID":"c3799a08-74cf-4334-824f-bc50ca6558c4","Type":"ContainerStarted","Data":"49b3f274f4a66ae6c00d0297a7fd8641d2cd1b30f379d139b1e7d917889489b3"}
Jul 23 12:10:10.951102 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:10.951078    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jmxz" event={"ID":"252ff8de-6507-4855-adda-acef49b9eec4","Type":"ContainerStarted","Data":"a25d5c5e52aa5fbdeeef475f339ab8877bf06a963e4a9ec684ee7a4c7d2ea0e1"}
Jul 23 12:10:10.952604 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:10.952581    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h4dhk" event={"ID":"2b38bd05-2ec3-4078-82eb-00b3d5d6d688","Type":"ContainerStarted","Data":"b26dee87d6eec6acd0b04a854200248370cbe941ddce9f94fe081f78de3a9824"}
Jul 23 12:10:10.954028 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:10.953994    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kc8fn" event={"ID":"26244712-6672-4444-b78f-55028760ff77","Type":"ContainerStarted","Data":"265703e73c0608607cb73c09baa107c57f30fa4641f48646996281e3f1d0b475"}
Jul 23 12:10:10.955487 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:10.955432    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal" event={"ID":"7a8a00ddbb4637bc24d59460275cb167","Type":"ContainerStarted","Data":"484d7675be966c4046f637fab50359cdb3df9e46ec8e87f1d63cb8178f65432e"}
Jul 23 12:10:11.003847 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.003800    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-105.ec2.internal" podStartSLOduration=12.003784972 podStartE2EDuration="12.003784972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:11.003396271 +0000 UTC m=+12.764515621" watchObservedRunningTime="2026-07-23 12:10:11.003784972 +0000 UTC m=+12.764904323"
Jul 23 12:10:11.027918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.027868    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nkl87" podStartSLOduration=2.512657022 podStartE2EDuration="13.027852527s" totalImagesPullingTime="10.515195505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:11.027134483 +0000 UTC m=+12.788253834" watchObservedRunningTime="2026-07-23 12:10:11.027852527 +0000 UTC m=+12.788971884"
Jul 23 12:10:11.047074 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.047029    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kc8fn" podStartSLOduration=2.561091835 podStartE2EDuration="13.047014365s" totalImagesPullingTime="10.48592253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:11.046440529 +0000 UTC m=+12.807559881" watchObservedRunningTime="2026-07-23 12:10:11.047014365 +0000 UTC m=+12.808133715"
Jul 23 12:10:11.094222 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.094166    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4jmxz" podStartSLOduration=2.688487082 podStartE2EDuration="13.094147346s" totalImagesPullingTime="10.405660264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:11.094095517 +0000 UTC m=+12.855214868" watchObservedRunningTime="2026-07-23 12:10:11.094147346 +0000 UTC m=+12.855266699"
Jul 23 12:10:11.094360 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.094315    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h4dhk" podStartSLOduration=2.62758169 podStartE2EDuration="13.094310343s" totalImagesPullingTime="10.466728653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:11.072593517 +0000 UTC m=+12.833712870" watchObservedRunningTime="2026-07-23 12:10:11.094310343 +0000 UTC m=+12.855429694"
Jul 23 12:10:11.732815 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.732787    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:11.732981 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:11.732913    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:11.732981 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.732958    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:11.733105 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:11.733086    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:11.959250 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.959214    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b5vm4" event={"ID":"3345a010-fc76-421e-a39a-2849a259d701","Type":"ContainerStarted","Data":"cb99db76e5a96c3104287928d4a070250fbdb77d6dce6d84331ab26dad247bf4"}
Jul 23 12:10:11.977036 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.976983    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b5vm4" podStartSLOduration=3.54062314 podStartE2EDuration="13.976965911s" totalImagesPullingTime="10.436342771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:11.976706606 +0000 UTC m=+13.737826184" watchObservedRunningTime="2026-07-23 12:10:11.976965911 +0000 UTC m=+13.738085262"
Jul 23 12:10:11.981798 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.981770    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:10:11.982304 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:11.982281    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:10:12.732545 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:12.732481    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:12.732725 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:12.732626    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:13.732547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:13.732461    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:13.732547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:13.732531    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:13.732958 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:13.732626    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:13.732958 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:13.732711    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:13.963879 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:13.963855    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 12:10:14.733494 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:14.733401    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:14.733895 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:14.733563    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:14.967174 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:14.967141    2570 generic.go:356] "Generic (PLEG): container finished" podID="7a8a00ddbb4637bc24d59460275cb167" containerID="484d7675be966c4046f637fab50359cdb3df9e46ec8e87f1d63cb8178f65432e" exitCode=0
Jul 23 12:10:14.967359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:14.967216    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal" event={"ID":"7a8a00ddbb4637bc24d59460275cb167","Type":"ContainerDied","Data":"484d7675be966c4046f637fab50359cdb3df9e46ec8e87f1d63cb8178f65432e"}
Jul 23 12:10:14.969336 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:14.969315    2570 generic.go:356] "Generic (PLEG): container finished" podID="52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849" containerID="328cceb471f80ade7f98073dfaa90f90f1e480dfa5455e37a08f807c76fe0016" exitCode=0
Jul 23 12:10:14.969416 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:14.969349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" event={"ID":"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849","Type":"ContainerDied","Data":"328cceb471f80ade7f98073dfaa90f90f1e480dfa5455e37a08f807c76fe0016"}
Jul 23 12:10:15.315733 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:15.315705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:15.315923 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.315851    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:15.315923 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.315920    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs podName:5245d445-4d3c-4f7d-94ea-c11197612fc9 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:31.315903328 +0000 UTC m=+33.077022657 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs") pod "network-metrics-daemon-cnjvr" (UID: "5245d445-4d3c-4f7d-94ea-c11197612fc9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:15.416415 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:15.416372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:15.416581 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.416514    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:15.416581 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.416574    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret podName:2fa7e528-7695-4a0e-a325-956ff07acf09 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:31.416558912 +0000 UTC m=+33.177678270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret") pod "global-pull-secret-syncer-nhxhc" (UID: "2fa7e528-7695-4a0e-a325-956ff07acf09") : object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:15.517379 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:15.517348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:15.517576 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.517525    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 12:10:15.517576 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.517554    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 12:10:15.517576 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.517567    2570 projected.go:196] Error preparing data for projected volume kube-api-access-gs577 for pod openshift-network-diagnostics/network-check-target-dqxkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:15.517706 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.517622    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577 podName:913714e7-afa4-4619-95ea-58ebf7a87df2 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:31.51760948 +0000 UTC m=+33.278728808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs577" (UniqueName: "kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577") pod "network-check-target-dqxkg" (UID: "913714e7-afa4-4619-95ea-58ebf7a87df2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:15.732426 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:15.732364    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:15.732426 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:15.732397    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:15.732615 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.732505    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:15.732615 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:15.732580    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:16.255036 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:16.254979    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:10:16.255686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:16.255191    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 12:10:16.255686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:16.255626    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4jmxz"
Jul 23 12:10:16.732175 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:16.732101    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:16.732333 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:16.732237    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:17.732644 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:17.732613    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:17.732644 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:17.732644    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:17.733138 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:17.732754    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:17.733138 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:17.732852    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:18.733697 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:18.733661    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:18.734073 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:18.733787    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:19.732195 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:19.732168    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:19.732291 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:19.732211    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:19.732326 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:19.732303    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:19.732449 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:19.732428    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:19.983586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:19.983343    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal" event={"ID":"7a8a00ddbb4637bc24d59460275cb167","Type":"ContainerStarted","Data":"d1125dc394e582f2a2b6acf94151a2a9cf405e2970b2118d664ade4605f08e5b"}
Jul 23 12:10:19.985185 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:19.985158    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jj2ss" event={"ID":"3ab2fce7-83a4-4712-bf18-a1bb14321a3e","Type":"ContainerStarted","Data":"7ee09796f6728c226dc30e16166127001eb95b939d144f952a3dbc3bd84211a5"}
Jul 23 12:10:19.987262 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:19.987212    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" event={"ID":"382af20d-20ca-4052-9c89-041dac32a6be","Type":"ContainerStarted","Data":"357a8d160371388a1be30086bba6c46803238ca035e5d73c08f16f0baf6e0eb0"}
Jul 23 12:10:19.987357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:19.987292    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" event={"ID":"382af20d-20ca-4052-9c89-041dac32a6be","Type":"ContainerStarted","Data":"b4f2e4e5220c0f82ef6006fad76e2d64dfeb8e5dca61ddfd185bc9c154f4175e"}
Jul 23 12:10:20.037107 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:20.037050    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jj2ss" podStartSLOduration=2.51202171 podStartE2EDuration="22.037033475s" totalImagesPullingTime="19.525011765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:20.013506469 +0000 UTC m=+21.774625821" watchObservedRunningTime="2026-07-23 12:10:20.037033475 +0000 UTC m=+21.798152826"
Jul 23 12:10:20.733085 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:20.733051    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:20.733286 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:20.733190    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:20.994103 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:20.994015    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" event={"ID":"382af20d-20ca-4052-9c89-041dac32a6be","Type":"ContainerStarted","Data":"85c854038be8e342c5b2b1618ad461cb3dfb0e220e933c7a4c13b91bad10861e"}
Jul 23 12:10:20.994713 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:20.994189    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" event={"ID":"382af20d-20ca-4052-9c89-041dac32a6be","Type":"ContainerStarted","Data":"8fdafe0d5b8eaff4df871f90ab7c0822de23c971c5f77fd880bec3867f0d6cf6"}
Jul 23 12:10:20.994713 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:20.994241    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" event={"ID":"382af20d-20ca-4052-9c89-041dac32a6be","Type":"ContainerStarted","Data":"fc17d7c0bbbb5b4d691b16208e58d56f074221e7fe71287a0d4d35a9fd8271b4"}
Jul 23 12:10:20.994713 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:20.994277    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" event={"ID":"382af20d-20ca-4052-9c89-041dac32a6be","Type":"ContainerStarted","Data":"cb8b4cb776afe0a02aedaba835b9786923dade77f855f54e7ad168c0feb67c94"}
Jul 23 12:10:20.995806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:20.995782    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9" event={"ID":"13c93698-28f6-4597-92c3-7b2e3fe6cfa9","Type":"ContainerStarted","Data":"b709be565fae9023a7bdf371e28030f53eacf38e1bdae7a6afe2a5271b41bc81"}
Jul 23 12:10:21.732244 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:21.732199    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:21.732525 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:21.732210    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:21.732525 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:21.732330    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:21.732525 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:21.732423    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:22.732535 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:22.732453    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:22.732919 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:22.732593    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:23.113024 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:23.113002    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 12:10:23.661752 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:23.661605    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T12:10:23.11301912Z","UUID":"9342c93f-982d-4dd4-9aa5-ccb269939668","Handler":null,"Name":"","Endpoint":""}
Jul 23 12:10:23.663128 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:23.663107    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 12:10:23.663269 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:23.663145    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 12:10:23.732785 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:23.732755    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:23.732785 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:23.732783    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:23.733161 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:23.732858    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:23.733161 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:23.732971    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:24.003245 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:24.003176    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9" event={"ID":"13c93698-28f6-4597-92c3-7b2e3fe6cfa9","Type":"ContainerStarted","Data":"e78d918a6d42f00b52b3cedfc63f74ce95b506c5d3a790bc2065c6c346fe7482"}
Jul 23 12:10:24.004753 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:24.004732    2570 generic.go:356] "Generic (PLEG): container finished" podID="52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849" containerID="0b393db255e9f7dcce58668c1a594881bb83e2ada341bfe2afff0fbf1e5e2ef1" exitCode=0
Jul 23 12:10:24.004871 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:24.004802    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" event={"ID":"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849","Type":"ContainerDied","Data":"0b393db255e9f7dcce58668c1a594881bb83e2ada341bfe2afff0fbf1e5e2ef1"}
Jul 23 12:10:24.007993 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:24.007964    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" event={"ID":"382af20d-20ca-4052-9c89-041dac32a6be","Type":"ContainerStarted","Data":"9f1d497723e4c2a5f71d58e10a0212120d28a4889a089333ec92557172ee8c3a"}
Jul 23 12:10:24.029785 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:24.029728    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-105.ec2.internal" podStartSLOduration=25.029716704 podStartE2EDuration="25.029716704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:20.03770013 +0000 UTC m=+21.798819480" watchObservedRunningTime="2026-07-23 12:10:24.029716704 +0000 UTC m=+25.790836055"
Jul 23 12:10:24.732428 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:24.732357    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:24.732649 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:24.732479    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:25.011781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:25.011704    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9" event={"ID":"13c93698-28f6-4597-92c3-7b2e3fe6cfa9","Type":"ContainerStarted","Data":"a7315d39091b6299068b65ed2dcb5b9b26f812253c3d6971f9c1fb723d8e78b6"}
Jul 23 12:10:25.030304 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:25.030260    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rpmp9" podStartSLOduration=2.793235157 podStartE2EDuration="27.030245679s" totalImagesPullingTime="24.237010522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=3 observedRunningTime="2026-07-23 12:10:25.030100809 +0000 UTC m=+26.791220160" watchObservedRunningTime="2026-07-23 12:10:25.030245679 +0000 UTC m=+26.791365051"
Jul 23 12:10:25.732430 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:25.732355    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:25.732613 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:25.732464    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:25.732613 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:25.732518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:25.732613 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:25.732599    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:26.015561 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:26.015493    2570 generic.go:356] "Generic (PLEG): container finished" podID="52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849" containerID="0c052977e647afc174dad58846b4d50832a099e82bea051fcc2b7d08193351a6" exitCode=0
Jul 23 12:10:26.016325 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:26.015563    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" event={"ID":"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849","Type":"ContainerDied","Data":"0c052977e647afc174dad58846b4d50832a099e82bea051fcc2b7d08193351a6"}
Jul 23 12:10:26.019352 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:26.019329    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" event={"ID":"382af20d-20ca-4052-9c89-041dac32a6be","Type":"ContainerStarted","Data":"c7f5fe91c74a173396c60c7266e795a22699ecbc3c61fcedfcd34256c88dcf57"}
Jul 23 12:10:26.079219 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:26.079167    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-992xp" podStartSLOduration=8.401914478 podStartE2EDuration="28.079152594s" totalImagesPullingTime="19.677238116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:26.078940251 +0000 UTC m=+27.840059606" watchObservedRunningTime="2026-07-23 12:10:26.079152594 +0000 UTC m=+27.840271944"
Jul 23 12:10:26.732502 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:26.732454    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:26.732675 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:26.732604    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:27.021759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.021501    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 12:10:27.021759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.021680    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:10:27.022173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.022071    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:10:27.038075 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.038052    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:10:27.038258 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.038246    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:10:27.461919 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.461889    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:10:27.470352 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.470329    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhxhc"]
Jul 23 12:10:27.470462 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.470425    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:27.470544 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:27.470526    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:27.475040 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.475014    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqxkg"]
Jul 23 12:10:27.475167 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.475109    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:27.475235 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:27.475206    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:27.475665 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.475644    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cnjvr"]
Jul 23 12:10:27.475757 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:27.475735    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:27.475837 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:27.475822    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:28.025691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:28.025662    2570 generic.go:356] "Generic (PLEG): container finished" podID="52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849" containerID="3091365e027fd541954356d9721ca07f0443beed753c3af7208fa91d5826867d" exitCode=0
Jul 23 12:10:28.026077 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:28.025737    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" event={"ID":"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849","Type":"ContainerDied","Data":"3091365e027fd541954356d9721ca07f0443beed753c3af7208fa91d5826867d"}
Jul 23 12:10:28.501255 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:28.501176    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:28.661080 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:28.661044    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:28.733302 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:28.733268    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:28.733487 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:28.733373    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:28.733487 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:28.733443    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:28.733618 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:28.733566    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:28.733729 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:28.733645    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:28.733729 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:28.733663    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:29.408189 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:29.408140    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:29.507299 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:29.507221    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:30.732764 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:30.732731    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:30.733127 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:30.732775    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:30.733127 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:30.732738    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:30.733127 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:30.732856    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqxkg" podUID="913714e7-afa4-4619-95ea-58ebf7a87df2"
Jul 23 12:10:30.733127 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:30.732960    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhxhc" podUID="2fa7e528-7695-4a0e-a325-956ff07acf09"
Jul 23 12:10:30.733127 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:30.733059    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cnjvr" podUID="5245d445-4d3c-4f7d-94ea-c11197612fc9"
Jul 23 12:10:31.332976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:31.332940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:31.333141 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:31.333095    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:31.333198 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:31.333163    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs podName:5245d445-4d3c-4f7d-94ea-c11197612fc9 nodeName:}" failed. No retries permitted until 2026-07-23 12:11:03.333147073 +0000 UTC m=+65.094266402 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs") pod "network-metrics-daemon-cnjvr" (UID: "5245d445-4d3c-4f7d-94ea-c11197612fc9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 12:10:31.433919 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:31.433883    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:31.434076 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:31.434041    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:31.434132 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:31.434114    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret podName:2fa7e528-7695-4a0e-a325-956ff07acf09 nodeName:}" failed. No retries permitted until 2026-07-23 12:11:03.434096243 +0000 UTC m=+65.195215575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret") pod "global-pull-secret-syncer-nhxhc" (UID: "2fa7e528-7695-4a0e-a325-956ff07acf09") : object "kube-system"/"original-pull-secret" not registered
Jul 23 12:10:31.534781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:31.534738    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:31.534973 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:31.534944    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 12:10:31.535058 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:31.534983    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 12:10:31.535058 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:31.534998    2570 projected.go:196] Error preparing data for projected volume kube-api-access-gs577 for pod openshift-network-diagnostics/network-check-target-dqxkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:31.535141 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:31.535061    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577 podName:913714e7-afa4-4619-95ea-58ebf7a87df2 nodeName:}" failed. No retries permitted until 2026-07-23 12:11:03.535041947 +0000 UTC m=+65.296161277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs577" (UniqueName: "kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577") pod "network-check-target-dqxkg" (UID: "913714e7-afa4-4619-95ea-58ebf7a87df2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 12:10:32.590784 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.590622    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-105.ec2.internal" event="NodeReady"
Jul 23 12:10:32.591209 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.590919    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 12:10:32.644673 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.644648    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6h9pt"]
Jul 23 12:10:32.670895 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.670867    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5xlxv"]
Jul 23 12:10:32.671015 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.670998    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.673524 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.673501    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 12:10:32.673524 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.673521    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dbmrb\""
Jul 23 12:10:32.673679 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.673550    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 12:10:32.691132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.691109    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6h9pt"]
Jul 23 12:10:32.691256 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.691143    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5xlxv"]
Jul 23 12:10:32.691256 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.691239    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5xlxv"
Jul 23 12:10:32.693716 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.693696    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 12:10:32.693825 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.693739    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 12:10:32.693907 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.693890    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 12:10:32.694001 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.693987    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2gntm\""
Jul 23 12:10:32.732330 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.732297    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:10:32.732506 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.732354    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:10:32.732506 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.732356    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:10:32.735412 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.735377    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 12:10:32.735562 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.735452    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 12:10:32.735562 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.735460    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pbg55\""
Jul 23 12:10:32.735562 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.735539    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 12:10:32.735732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.735619    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k5z96\""
Jul 23 12:10:32.735732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.735693    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 12:10:32.743888 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.743862    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz8fb\" (UniqueName: \"kubernetes.io/projected/a8f481be-e4e0-45c9-8234-fa269d200260-kube-api-access-tz8fb\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.743988 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.743907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f481be-e4e0-45c9-8234-fa269d200260-tmp-dir\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.743988 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.743946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.744089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.744072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f481be-e4e0-45c9-8234-fa269d200260-config-volume\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.845167 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.845094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f481be-e4e0-45c9-8234-fa269d200260-config-volume\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.845167 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.845136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz8fb\" (UniqueName: \"kubernetes.io/projected/a8f481be-e4e0-45c9-8234-fa269d200260-kube-api-access-tz8fb\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.845167 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.845158    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f481be-e4e0-45c9-8234-fa269d200260-tmp-dir\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.845417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.845191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66r4f\" (UniqueName: \"kubernetes.io/projected/9dae6922-ec15-490b-be22-96434e7dfd79-kube-api-access-66r4f\") pod \"ingress-canary-5xlxv\" (UID: \"9dae6922-ec15-490b-be22-96434e7dfd79\") " pod="openshift-ingress-canary/ingress-canary-5xlxv"
Jul 23 12:10:32.845417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.845213    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.845417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.845253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dae6922-ec15-490b-be22-96434e7dfd79-cert\") pod \"ingress-canary-5xlxv\" (UID: \"9dae6922-ec15-490b-be22-96434e7dfd79\") " pod="openshift-ingress-canary/ingress-canary-5xlxv"
Jul 23 12:10:32.845417 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:32.845335    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 12:10:32.845417 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:32.845410    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls podName:a8f481be-e4e0-45c9-8234-fa269d200260 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:33.345390856 +0000 UTC m=+35.106510193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls") pod "dns-default-6h9pt" (UID: "a8f481be-e4e0-45c9-8234-fa269d200260") : secret "dns-default-metrics-tls" not found
Jul 23 12:10:32.845697 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.845586    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f481be-e4e0-45c9-8234-fa269d200260-tmp-dir\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.845790 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.845772    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f481be-e4e0-45c9-8234-fa269d200260-config-volume\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.857553 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.857529    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz8fb\" (UniqueName: \"kubernetes.io/projected/a8f481be-e4e0-45c9-8234-fa269d200260-kube-api-access-tz8fb\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:32.945720 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.945689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66r4f\" (UniqueName: \"kubernetes.io/projected/9dae6922-ec15-490b-be22-96434e7dfd79-kube-api-access-66r4f\") pod \"ingress-canary-5xlxv\" (UID: \"9dae6922-ec15-490b-be22-96434e7dfd79\") " pod="openshift-ingress-canary/ingress-canary-5xlxv"
Jul 23 12:10:32.945881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.945743    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dae6922-ec15-490b-be22-96434e7dfd79-cert\") pod \"ingress-canary-5xlxv\" (UID: \"9dae6922-ec15-490b-be22-96434e7dfd79\") " pod="openshift-ingress-canary/ingress-canary-5xlxv"
Jul 23 12:10:32.947955 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.947935    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dae6922-ec15-490b-be22-96434e7dfd79-cert\") pod \"ingress-canary-5xlxv\" (UID: \"9dae6922-ec15-490b-be22-96434e7dfd79\") " pod="openshift-ingress-canary/ingress-canary-5xlxv"
Jul 23 12:10:32.955867 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.955845    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66r4f\" (UniqueName: \"kubernetes.io/projected/9dae6922-ec15-490b-be22-96434e7dfd79-kube-api-access-66r4f\") pod \"ingress-canary-5xlxv\" (UID: \"9dae6922-ec15-490b-be22-96434e7dfd79\") " pod="openshift-ingress-canary/ingress-canary-5xlxv"
Jul 23 12:10:32.999952 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:32.999931    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5xlxv"
Jul 23 12:10:33.040650 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:33.040615    2570 generic.go:356] "Generic (PLEG): container finished" podID="52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849" containerID="89bc79a64494d4651b390b1ac7d064341f22cdf256f7fe7a21aa6c9c28b8a6f6" exitCode=0
Jul 23 12:10:33.040826 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:33.040675    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" event={"ID":"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849","Type":"ContainerDied","Data":"89bc79a64494d4651b390b1ac7d064341f22cdf256f7fe7a21aa6c9c28b8a6f6"}
Jul 23 12:10:33.137764 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:33.137731    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5xlxv"]
Jul 23 12:10:33.140150 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:10:33.140128    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dae6922_ec15_490b_be22_96434e7dfd79.slice/crio-dc05c73837c03dfa4414eae6c941752a5f25ef0bb3fb3a659fc8e0a7c8331d32 WatchSource:0}: Error finding container dc05c73837c03dfa4414eae6c941752a5f25ef0bb3fb3a659fc8e0a7c8331d32: Status 404 returned error can't find the container with id dc05c73837c03dfa4414eae6c941752a5f25ef0bb3fb3a659fc8e0a7c8331d32
Jul 23 12:10:33.348401 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:33.348291    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:33.348548 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:33.348462    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 12:10:33.348595 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:33.348557    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls podName:a8f481be-e4e0-45c9-8234-fa269d200260 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:34.348540215 +0000 UTC m=+36.109659551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls") pod "dns-default-6h9pt" (UID: "a8f481be-e4e0-45c9-8234-fa269d200260") : secret "dns-default-metrics-tls" not found
Jul 23 12:10:34.044335 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:34.044294    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5xlxv" event={"ID":"9dae6922-ec15-490b-be22-96434e7dfd79","Type":"ContainerStarted","Data":"dc05c73837c03dfa4414eae6c941752a5f25ef0bb3fb3a659fc8e0a7c8331d32"}
Jul 23 12:10:34.047631 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:34.047601    2570 generic.go:356] "Generic (PLEG): container finished" podID="52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849" containerID="d29e31e2f8c29e9fbf773b7aee6997d26d1c5441b789c42abb2bb42b72947e7b" exitCode=0
Jul 23 12:10:34.047750 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:34.047635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" event={"ID":"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849","Type":"ContainerDied","Data":"d29e31e2f8c29e9fbf773b7aee6997d26d1c5441b789c42abb2bb42b72947e7b"}
Jul 23 12:10:34.356022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:34.355937    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:34.356159 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:34.356087    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 12:10:34.356202 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:34.356157    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls podName:a8f481be-e4e0-45c9-8234-fa269d200260 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:36.356136177 +0000 UTC m=+38.117255509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls") pod "dns-default-6h9pt" (UID: "a8f481be-e4e0-45c9-8234-fa269d200260") : secret "dns-default-metrics-tls" not found
Jul 23 12:10:35.055643 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:35.055609    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" event={"ID":"52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849","Type":"ContainerStarted","Data":"d14d8de1578ac66cd3915eaec32e7baf376809a6d43e7d2ddf68c96f3e9126e2"}
Jul 23 12:10:35.082813 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:35.082746    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hcc2t" podStartSLOduration=11.618856132 podStartE2EDuration="37.082724513s" totalImagesPullingTime="25.463868381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:35.081445603 +0000 UTC m=+36.842564957" watchObservedRunningTime="2026-07-23 12:10:35.082724513 +0000 UTC m=+36.843843867"
Jul 23 12:10:35.208980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:35.208948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:35.269587 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:35.269545    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:35.714101 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:35.714064    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:35.770997 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:35.770965    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:36.059331 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:36.059238    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5xlxv" event={"ID":"9dae6922-ec15-490b-be22-96434e7dfd79","Type":"ContainerStarted","Data":"8fa581d46bb89ecc78d05819b4295757e95e3abe71d834631856368267544f5c"}
Jul 23 12:10:36.077913 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:36.077856    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5xlxv" podStartSLOduration=1.886397471 podStartE2EDuration="4.077839425s" totalImagesPullingTime="2.191441954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:10:36.076655146 +0000 UTC m=+37.837774493" watchObservedRunningTime="2026-07-23 12:10:36.077839425 +0000 UTC m=+37.838958776"
Jul 23 12:10:36.373556 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:36.373435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:36.373707 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:36.373591    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 12:10:36.373707 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:36.373656    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls podName:a8f481be-e4e0-45c9-8234-fa269d200260 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:40.373642086 +0000 UTC m=+42.134761415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls") pod "dns-default-6h9pt" (UID: "a8f481be-e4e0-45c9-8234-fa269d200260") : secret "dns-default-metrics-tls" not found
Jul 23 12:10:39.282064 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:39.281881    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:39.358740 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:39.358713    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:39.459558 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:39.459528    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:40.352164 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:40.352125    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:40.401964 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:40.401928    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:40.402094 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:40.402074    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 12:10:40.402151 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:40.402142    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls podName:a8f481be-e4e0-45c9-8234-fa269d200260 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:48.40212462 +0000 UTC m=+50.163243949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls") pod "dns-default-6h9pt" (UID: "a8f481be-e4e0-45c9-8234-fa269d200260") : secret "dns-default-metrics-tls" not found
Jul 23 12:10:40.412937 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:40.412903    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:43.294635 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.294599    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"]
Jul 23 12:10:43.328721 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.328684    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"]
Jul 23 12:10:43.328882 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.328791    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:43.333339 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.333310    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 12:10:43.333614 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.333590    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 12:10:43.333614 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.333602    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2vxmx\""
Jul 23 12:10:43.333772 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.333621    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 12:10:43.333772 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.333605    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 12:10:43.406645 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.406610    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7446c55b64-2xtn9"]
Jul 23 12:10:43.422733 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.422704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7709b281-8fb5-44e2-a2db-e8a5d50505cb-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:43.422888 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.422748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:43.422888 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.422829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b79xl\" (UniqueName: \"kubernetes.io/projected/7709b281-8fb5-44e2-a2db-e8a5d50505cb-kube-api-access-b79xl\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:43.426623 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.426601    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7446c55b64-2xtn9"]
Jul 23 12:10:43.426707 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.426693    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.429825 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.429802    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 12:10:43.429934 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.429912    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6zl85\""
Jul 23 12:10:43.430143 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.429883    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 12:10:43.430143 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.429962    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 12:10:43.430143 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.429868    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 12:10:43.430143 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.430040    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 12:10:43.430143 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.429914    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 12:10:43.509216 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.509185    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-b2ccs"]
Jul 23 12:10:43.523762 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.523720    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7709b281-8fb5-44e2-a2db-e8a5d50505cb-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:43.523933 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.523770    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tct45\" (UniqueName: \"kubernetes.io/projected/365a7b42-7e90-4da9-84d0-8546d85da537-kube-api-access-tct45\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.523933 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.523800    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.523933 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.523835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-default-certificate\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.523933 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.523886    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:43.524139 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.523935    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b79xl\" (UniqueName: \"kubernetes.io/projected/7709b281-8fb5-44e2-a2db-e8a5d50505cb-kube-api-access-b79xl\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:43.524139 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.523959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-stats-auth\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.524235 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.524182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.524405 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.524386    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:43.524502 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.524488    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls podName:7709b281-8fb5-44e2-a2db-e8a5d50505cb nodeName:}" failed. No retries permitted until 2026-07-23 12:10:44.024448852 +0000 UTC m=+45.785568183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-d7nq5" (UID: "7709b281-8fb5-44e2-a2db-e8a5d50505cb") : secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:43.524846 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.524825    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7709b281-8fb5-44e2-a2db-e8a5d50505cb-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:43.530226 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.530204    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-b2ccs"]
Jul 23 12:10:43.530323 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.530285    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.533046 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.533024    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 12:10:43.533380 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.533364    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mlkn5\""
Jul 23 12:10:43.533679 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.533663    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 12:10:43.533758 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.533716    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 12:10:43.535018 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.535003    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 12:10:43.540049 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.540031    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 12:10:43.543133 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.543112    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b79xl\" (UniqueName: \"kubernetes.io/projected/7709b281-8fb5-44e2-a2db-e8a5d50505cb-kube-api-access-b79xl\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:43.568001 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.567917    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:43.601347 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.601316    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"]
Jul 23 12:10:43.625110 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.625082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.625110 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.625113    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tct45\" (UniqueName: \"kubernetes.io/projected/365a7b42-7e90-4da9-84d0-8546d85da537-kube-api-access-tct45\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.625298 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.625133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec546b3e-11ce-42a8-9482-a9103f11490d-serving-cert\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.625298 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.625151    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.625298 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.625181    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-default-certificate\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.625298 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.625232    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 12:10:43.625298 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.625248    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec546b3e-11ce-42a8-9482-a9103f11490d-trusted-ca\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.625298 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.625285    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:44.12526667 +0000 UTC m=+45.886385999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : secret "router-metrics-certs-default" not found
Jul 23 12:10:43.625546 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.625321    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-stats-auth\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.625546 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.625376    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:44.125357002 +0000 UTC m=+45.886476334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : configmap references non-existent config key: service-ca.crt
Jul 23 12:10:43.625546 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.625432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec546b3e-11ce-42a8-9482-a9103f11490d-config\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.625546 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.625454    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nwtr\" (UniqueName: \"kubernetes.io/projected/ec546b3e-11ce-42a8-9482-a9103f11490d-kube-api-access-4nwtr\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.626070 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.626055    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-679d56cf84-lfw28"]
Jul 23 12:10:43.626214 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.626196    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:43.627949 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.627918    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-default-certificate\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.628054 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.627923    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-stats-auth\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.628809 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.628790    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lm26f\""
Jul 23 12:10:43.628914 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.628814    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 12:10:43.628914 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.628861    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 12:10:43.629024 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.628865    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 12:10:43.635125 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.635106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tct45\" (UniqueName: \"kubernetes.io/projected/365a7b42-7e90-4da9-84d0-8546d85da537-kube-api-access-tct45\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:43.644179 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.644159    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"]
Jul 23 12:10:43.644278 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.644201    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-679d56cf84-lfw28"]
Jul 23 12:10:43.644351 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.644317    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.644510 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.644489    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:43.647308 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.647291    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 12:10:43.647423 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.647328    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 12:10:43.647576 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.647563    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdbs4\""
Jul 23 12:10:43.647617 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.647572    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 12:10:43.655604 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.655570    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 12:10:43.726249 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.726216    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec546b3e-11ce-42a8-9482-a9103f11490d-config\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.726249 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.726255    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nwtr\" (UniqueName: \"kubernetes.io/projected/ec546b3e-11ce-42a8-9482-a9103f11490d-kube-api-access-4nwtr\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.726505 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.726305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec546b3e-11ce-42a8-9482-a9103f11490d-serving-cert\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.726505 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.726380    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec546b3e-11ce-42a8-9482-a9103f11490d-trusted-ca\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.726505 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.726422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s6mr\" (UniqueName: \"kubernetes.io/projected/207b2f55-bd62-4d3a-872d-5d73c796184d-kube-api-access-2s6mr\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:43.726749 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.726519    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:43.726984 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.726962    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec546b3e-11ce-42a8-9482-a9103f11490d-config\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.728819 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.728786    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec546b3e-11ce-42a8-9482-a9103f11490d-serving-cert\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.736670 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.736643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nwtr\" (UniqueName: \"kubernetes.io/projected/ec546b3e-11ce-42a8-9482-a9103f11490d-kube-api-access-4nwtr\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.737787 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.737768    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec546b3e-11ce-42a8-9482-a9103f11490d-trusted-ca\") pod \"console-operator-565b7b569d-b2ccs\" (UID: \"ec546b3e-11ce-42a8-9482-a9103f11490d\") " pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.827864 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.827766    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgst6\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-kube-api-access-qgst6\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.828004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.827878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-trusted-ca\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.828004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.827905    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-certificates\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.828004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.827926    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:43.828004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.827946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.828004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.827972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s6mr\" (UniqueName: \"kubernetes.io/projected/207b2f55-bd62-4d3a-872d-5d73c796184d-kube-api-access-2s6mr\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:43.828158 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.828048    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 12:10:43.828158 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.828118    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls podName:207b2f55-bd62-4d3a-872d-5d73c796184d nodeName:}" failed. No retries permitted until 2026-07-23 12:10:44.328099017 +0000 UTC m=+46.089218349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-cc5f9" (UID: "207b2f55-bd62-4d3a-872d-5d73c796184d") : secret "samples-operator-tls" not found
Jul 23 12:10:43.828158 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.828145    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-image-registry-private-configuration\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.828272 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.828168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-bound-sa-token\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.828272 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.828209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aceee503-0fbf-409f-aa5f-a7ade42bf54a-ca-trust-extracted\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.828272 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.828236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-installation-pull-secrets\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.838879 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.838846    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s6mr\" (UniqueName: \"kubernetes.io/projected/207b2f55-bd62-4d3a-872d-5d73c796184d-kube-api-access-2s6mr\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:43.839572 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.839551    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:43.929673 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.929626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-trusted-ca\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.929819 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.929778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-certificates\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.929876 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.929827    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.929876 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.929852    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-image-registry-private-configuration\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.929876 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.929870    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-bound-sa-token\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.930006 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.929893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aceee503-0fbf-409f-aa5f-a7ade42bf54a-ca-trust-extracted\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.930006 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.929909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-installation-pull-secrets\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.930006 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.929933    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgst6\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-kube-api-access-qgst6\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.930154 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.930061    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 12:10:43.930154 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.930093    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679d56cf84-lfw28: secret "image-registry-tls" not found
Jul 23 12:10:43.930234 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:43.930182    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls podName:aceee503-0fbf-409f-aa5f-a7ade42bf54a nodeName:}" failed. No retries permitted until 2026-07-23 12:10:44.430145628 +0000 UTC m=+46.191264971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls") pod "image-registry-679d56cf84-lfw28" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a") : secret "image-registry-tls" not found
Jul 23 12:10:43.930507 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.930459    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-certificates\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.930688 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.930669    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-trusted-ca\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.930789 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.930682    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aceee503-0fbf-409f-aa5f-a7ade42bf54a-ca-trust-extracted\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.932555 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.932535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-installation-pull-secrets\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.932614 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.932568    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-image-registry-private-configuration\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.939828 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.939802    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-bound-sa-token\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.939828 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.939819    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgst6\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-kube-api-access-qgst6\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:43.987541 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:43.987506    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-b2ccs"]
Jul 23 12:10:43.991606 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:10:43.991577    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec546b3e_11ce_42a8_9482_a9103f11490d.slice/crio-236a5d97d49ed8876099f23d5ac3a313cff044a359b72823639fe9de4614296f WatchSource:0}: Error finding container 236a5d97d49ed8876099f23d5ac3a313cff044a359b72823639fe9de4614296f: Status 404 returned error can't find the container with id 236a5d97d49ed8876099f23d5ac3a313cff044a359b72823639fe9de4614296f
Jul 23 12:10:44.030701 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:44.030662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:44.030866 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.030852    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:44.030919 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.030908    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls podName:7709b281-8fb5-44e2-a2db-e8a5d50505cb nodeName:}" failed. No retries permitted until 2026-07-23 12:10:45.030894245 +0000 UTC m=+46.792013577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-d7nq5" (UID: "7709b281-8fb5-44e2-a2db-e8a5d50505cb") : secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:44.080806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:44.080722    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs" event={"ID":"ec546b3e-11ce-42a8-9482-a9103f11490d","Type":"ContainerStarted","Data":"236a5d97d49ed8876099f23d5ac3a313cff044a359b72823639fe9de4614296f"}
Jul 23 12:10:44.131618 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:44.131583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:44.131618 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:44.131617    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:44.131809 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.131727    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 12:10:44.131809 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.131746    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:45.13173073 +0000 UTC m=+46.892850065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : configmap references non-existent config key: service-ca.crt
Jul 23 12:10:44.131809 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.131779    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:45.131766571 +0000 UTC m=+46.892885903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : secret "router-metrics-certs-default" not found
Jul 23 12:10:44.333446 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:44.333362    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:44.334049 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.333538    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 12:10:44.334049 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.333602    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls podName:207b2f55-bd62-4d3a-872d-5d73c796184d nodeName:}" failed. No retries permitted until 2026-07-23 12:10:45.333584504 +0000 UTC m=+47.094703837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-cc5f9" (UID: "207b2f55-bd62-4d3a-872d-5d73c796184d") : secret "samples-operator-tls" not found
Jul 23 12:10:44.362452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:44.362416    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:44.434771 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:44.434736    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:44.434921 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.434886    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 12:10:44.434921 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.434903    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679d56cf84-lfw28: secret "image-registry-tls" not found
Jul 23 12:10:44.435019 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:44.434966    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls podName:aceee503-0fbf-409f-aa5f-a7ade42bf54a nodeName:}" failed. No retries permitted until 2026-07-23 12:10:45.434941417 +0000 UTC m=+47.196060748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls") pod "image-registry-679d56cf84-lfw28" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a") : secret "image-registry-tls" not found
Jul 23 12:10:45.039774 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:45.039739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:45.039942 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.039917    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:45.040002 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.039995    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls podName:7709b281-8fb5-44e2-a2db-e8a5d50505cb nodeName:}" failed. No retries permitted until 2026-07-23 12:10:47.039974219 +0000 UTC m=+48.801093555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-d7nq5" (UID: "7709b281-8fb5-44e2-a2db-e8a5d50505cb") : secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:45.141089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:45.141056    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:45.141303 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:45.141099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:45.141303 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.141236    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 12:10:45.141303 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.141301    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:47.14128114 +0000 UTC m=+48.902400473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : configmap references non-existent config key: service-ca.crt
Jul 23 12:10:45.141456 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.141323    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:47.141313203 +0000 UTC m=+48.902432540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : secret "router-metrics-certs-default" not found
Jul 23 12:10:45.195896 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:45.195866    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:45.270266 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:45.270226    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:45.342520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:45.342437    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:45.342830 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.342596    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 12:10:45.342830 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.342662    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls podName:207b2f55-bd62-4d3a-872d-5d73c796184d nodeName:}" failed. No retries permitted until 2026-07-23 12:10:47.342646243 +0000 UTC m=+49.103765571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-cc5f9" (UID: "207b2f55-bd62-4d3a-872d-5d73c796184d") : secret "samples-operator-tls" not found
Jul 23 12:10:45.443245 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:45.443217    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:45.443405 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.443358    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 12:10:45.443405 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.443375    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679d56cf84-lfw28: secret "image-registry-tls" not found
Jul 23 12:10:45.443488 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:45.443428    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls podName:aceee503-0fbf-409f-aa5f-a7ade42bf54a nodeName:}" failed. No retries permitted until 2026-07-23 12:10:47.443414933 +0000 UTC m=+49.204534263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls") pod "image-registry-679d56cf84-lfw28" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a") : secret "image-registry-tls" not found
Jul 23 12:10:46.410828 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:46.410800    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:47.057172 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:47.057137    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:47.057336 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.057282    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:47.057382 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.057344    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls podName:7709b281-8fb5-44e2-a2db-e8a5d50505cb nodeName:}" failed. No retries permitted until 2026-07-23 12:10:51.057329067 +0000 UTC m=+52.818448397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-d7nq5" (UID: "7709b281-8fb5-44e2-a2db-e8a5d50505cb") : secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:47.090361 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:47.090336    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/0.log"
Jul 23 12:10:47.090501 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:47.090376    2570 generic.go:356] "Generic (PLEG): container finished" podID="ec546b3e-11ce-42a8-9482-a9103f11490d" containerID="3e2330596f83cb2e73070bb4d27a4db3b1464ad5f3f6584f8225c6a2d990cf54" exitCode=255
Jul 23 12:10:47.090501 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:47.090446    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs" event={"ID":"ec546b3e-11ce-42a8-9482-a9103f11490d","Type":"ContainerDied","Data":"3e2330596f83cb2e73070bb4d27a4db3b1464ad5f3f6584f8225c6a2d990cf54"}
Jul 23 12:10:47.090720 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:47.090707    2570 scope.go:117] "RemoveContainer" containerID="3e2330596f83cb2e73070bb4d27a4db3b1464ad5f3f6584f8225c6a2d990cf54"
Jul 23 12:10:47.160785 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:47.158128    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:47.160785 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:47.158199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:47.160785 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.158520    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 12:10:47.160785 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.158559    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:51.158526456 +0000 UTC m=+52.919645802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : configmap references non-existent config key: service-ca.crt
Jul 23 12:10:47.160785 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.158590    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:51.15857874 +0000 UTC m=+52.919698084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : secret "router-metrics-certs-default" not found
Jul 23 12:10:47.360330 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:47.360227    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:47.360505 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.360367    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 12:10:47.360505 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.360483    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls podName:207b2f55-bd62-4d3a-872d-5d73c796184d nodeName:}" failed. No retries permitted until 2026-07-23 12:10:51.360451085 +0000 UTC m=+53.121570414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-cc5f9" (UID: "207b2f55-bd62-4d3a-872d-5d73c796184d") : secret "samples-operator-tls" not found
Jul 23 12:10:47.460706 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:47.460668    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:47.461087 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.460831    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 12:10:47.461087 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.460854    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679d56cf84-lfw28: secret "image-registry-tls" not found
Jul 23 12:10:47.461087 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:47.460911    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls podName:aceee503-0fbf-409f-aa5f-a7ade42bf54a nodeName:}" failed. No retries permitted until 2026-07-23 12:10:51.460895377 +0000 UTC m=+53.222014706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls") pod "image-registry-679d56cf84-lfw28" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a") : secret "image-registry-tls" not found
Jul 23 12:10:48.094555 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:48.094531    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:10:48.094891 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:48.094875    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/0.log"
Jul 23 12:10:48.094990 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:48.094914    2570 generic.go:356] "Generic (PLEG): container finished" podID="ec546b3e-11ce-42a8-9482-a9103f11490d" containerID="37fa2fa706a104d14c796066385c754936e3e1a3a43b40e89bbd1022ce1409b2" exitCode=255
Jul 23 12:10:48.094990 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:48.094958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs" event={"ID":"ec546b3e-11ce-42a8-9482-a9103f11490d","Type":"ContainerDied","Data":"37fa2fa706a104d14c796066385c754936e3e1a3a43b40e89bbd1022ce1409b2"}
Jul 23 12:10:48.095099 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:48.095042    2570 scope.go:117] "RemoveContainer" containerID="3e2330596f83cb2e73070bb4d27a4db3b1464ad5f3f6584f8225c6a2d990cf54"
Jul 23 12:10:48.095311 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:48.095296    2570 scope.go:117] "RemoveContainer" containerID="37fa2fa706a104d14c796066385c754936e3e1a3a43b40e89bbd1022ce1409b2"
Jul 23 12:10:48.095510 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:48.095463    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-b2ccs_openshift-console-operator(ec546b3e-11ce-42a8-9482-a9103f11490d)\"" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs" podUID="ec546b3e-11ce-42a8-9482-a9103f11490d"
Jul 23 12:10:48.468509 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:48.468449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:10:48.468957 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:48.468628    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 12:10:48.468957 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:48.468732    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls podName:a8f481be-e4e0-45c9-8234-fa269d200260 nodeName:}" failed. No retries permitted until 2026-07-23 12:11:04.46871128 +0000 UTC m=+66.229830609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls") pod "dns-default-6h9pt" (UID: "a8f481be-e4e0-45c9-8234-fa269d200260") : secret "dns-default-metrics-tls" not found
Jul 23 12:10:49.098514 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.098488    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:10:49.098807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.098792    2570 scope.go:117] "RemoveContainer" containerID="37fa2fa706a104d14c796066385c754936e3e1a3a43b40e89bbd1022ce1409b2"
Jul 23 12:10:49.098946 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:49.098926    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-b2ccs_openshift-console-operator(ec546b3e-11ce-42a8-9482-a9103f11490d)\"" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs" podUID="ec546b3e-11ce-42a8-9482-a9103f11490d"
Jul 23 12:10:49.384496 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.384402    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pd9r4"]
Jul 23 12:10:49.397716 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.397691    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.400904 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.400885    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 12:10:49.401042 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.400930    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l7bff\""
Jul 23 12:10:49.401042 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.400883    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 12:10:49.401200 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.401173    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 12:10:49.401250 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.401187    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 12:10:49.406960 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.406924    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pd9r4"]
Jul 23 12:10:49.415643 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.415619    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:49.475510 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.475454    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.475921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.475527    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9a392ff-04c5-4877-8217-0cb6622a71b5-data-volume\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.475921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.475550    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlq54\" (UniqueName: \"kubernetes.io/projected/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-api-access-dlq54\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.475921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.475590    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d9a392ff-04c5-4877-8217-0cb6622a71b5-crio-socket\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.475921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.475681    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.576393 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.576355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d9a392ff-04c5-4877-8217-0cb6622a71b5-crio-socket\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.576575 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.576427    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.576575 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.576526    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.576575 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.576571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9a392ff-04c5-4877-8217-0cb6622a71b5-data-volume\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.576684 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:49.576585    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:49.576684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.576593    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlq54\" (UniqueName: \"kubernetes.io/projected/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-api-access-dlq54\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.576684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.576615    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d9a392ff-04c5-4877-8217-0cb6622a71b5-crio-socket\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.576684 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:49.576648    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:50.076632193 +0000 UTC m=+51.837751522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:49.576684 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:49.576649    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 12:10:49.576867 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:49.576706    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:50.076689977 +0000 UTC m=+51.837809306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : configmap "kube-rbac-proxy" not found
Jul 23 12:10:49.576945 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.576929    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9a392ff-04c5-4877-8217-0cb6622a71b5-data-volume\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.593800 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.593768    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:49.593934 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.593862    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlq54\" (UniqueName: \"kubernetes.io/projected/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-api-access-dlq54\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:49.693031 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.692940    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:49.762343 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:49.762307    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:50.052822 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:50.052780    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:50.080056 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:50.080021    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:50.080214 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:50.080126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:50.080214 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:50.080147    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 12:10:50.080278 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:50.080215    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:51.080194125 +0000 UTC m=+52.841313457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : configmap "kube-rbac-proxy" not found
Jul 23 12:10:50.080278 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:50.080238    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:50.080346 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:50.080284    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:51.080271996 +0000 UTC m=+52.841391325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:50.117695 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:50.117647    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:50.481792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:50.481766    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:50.545284 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:50.545252    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:50.751775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:50.751689    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:50.848859 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:50.848826    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:50.970663 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:50.970637    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kc8fn_26244712-6672-4444-b78f-55028760ff77/dns-node-resolver/0.log"
Jul 23 12:10:51.089101 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.089015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:51.089101 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.089064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:51.089272 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.089141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:51.089272 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.089171    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:51.089272 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.089215    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 12:10:51.089272 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.089230    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls podName:7709b281-8fb5-44e2-a2db-e8a5d50505cb nodeName:}" failed. No retries permitted until 2026-07-23 12:10:59.089215103 +0000 UTC m=+60.850334431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-d7nq5" (UID: "7709b281-8fb5-44e2-a2db-e8a5d50505cb") : secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:51.089272 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.089244    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:51.089272 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.089264    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:53.089251924 +0000 UTC m=+54.850371253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : configmap "kube-rbac-proxy" not found
Jul 23 12:10:51.089452 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.089281    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:53.089272149 +0000 UTC m=+54.850391478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:51.189676 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.189637    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:51.189676 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.189685    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:51.189871 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.189808    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 12:10:51.189910 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.189874    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:59.189856067 +0000 UTC m=+60.950975397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : secret "router-metrics-certs-default" not found
Jul 23 12:10:51.189910 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.189888    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:59.189881498 +0000 UTC m=+60.951000826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : configmap references non-existent config key: service-ca.crt
Jul 23 12:10:51.391359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.391268    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:51.391529 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.391424    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 12:10:51.391529 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.391511    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls podName:207b2f55-bd62-4d3a-872d-5d73c796184d nodeName:}" failed. No retries permitted until 2026-07-23 12:10:59.391491571 +0000 UTC m=+61.152610920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-cc5f9" (UID: "207b2f55-bd62-4d3a-872d-5d73c796184d") : secret "samples-operator-tls" not found
Jul 23 12:10:51.399967 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.399924    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:51.492231 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.492188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:51.492615 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.492342    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 12:10:51.492615 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.492361    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679d56cf84-lfw28: secret "image-registry-tls" not found
Jul 23 12:10:51.492615 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:51.492415    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls podName:aceee503-0fbf-409f-aa5f-a7ade42bf54a nodeName:}" failed. No retries permitted until 2026-07-23 12:10:59.492399872 +0000 UTC m=+61.253519202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls") pod "image-registry-679d56cf84-lfw28" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a") : secret "image-registry-tls" not found
Jul 23 12:10:51.506718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.506689    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:51.971903 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:51.971877    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h4dhk_2b38bd05-2ec3-4078-82eb-00b3d5d6d688/node-ca/0.log"
Jul 23 12:10:52.393764 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:52.393674    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:52.492858 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:52.492826    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:52.570575 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:52.570544    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5xlxv_9dae6922-ec15-490b-be22-96434e7dfd79/serve-healthcheck-canary/0.log"
Jul 23 12:10:53.105960 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:53.105917    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:53.106127 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:53.106030    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:53.106127 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:53.106068    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:53.106214 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:53.106128    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:57.106113969 +0000 UTC m=+58.867233299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:53.106214 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:53.106131    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 12:10:53.106214 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:53.106182    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:10:57.106167425 +0000 UTC m=+58.867286773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : configmap "kube-rbac-proxy" not found
Jul 23 12:10:53.319056 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:53.319018    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:53.839804 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:53.839762    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:53.840211 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:53.839825    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:10:53.840211 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:53.840127    2570 scope.go:117] "RemoveContainer" containerID="37fa2fa706a104d14c796066385c754936e3e1a3a43b40e89bbd1022ce1409b2"
Jul 23 12:10:53.840282 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:53.840263    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-b2ccs_openshift-console-operator(ec546b3e-11ce-42a8-9482-a9103f11490d)\"" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs" podUID="ec546b3e-11ce-42a8-9482-a9103f11490d"
Jul 23 12:10:54.524006 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:54.523960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:54.621758 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:54.621724    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:54.721611 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:54.721570    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:54.826867 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:54.826770    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:54.911076 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:54.911043    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:55.192832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:55.192744    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:55.599229 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:55.599192    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:56.002860 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:56.002827    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:56.067984 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:56.067959    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:56.179944 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:56.179918    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:56.579123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:56.579092    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:56.781906 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:56.781875    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:56.978772 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:56.978740    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:57.136694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:57.136666    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:57.137061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:57.136779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:10:57.137061 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:57.136805    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 12:10:57.137061 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:57.136872    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:11:05.136851434 +0000 UTC m=+66.897970775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : configmap "kube-rbac-proxy" not found
Jul 23 12:10:57.137061 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:57.136926    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:57.137061 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:57.136983    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls podName:d9a392ff-04c5-4877-8217-0cb6622a71b5 nodeName:}" failed. No retries permitted until 2026-07-23 12:11:05.136970455 +0000 UTC m=+66.898089783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pd9r4" (UID: "d9a392ff-04c5-4877-8217-0cb6622a71b5") : secret "insights-runtime-extractor-tls" not found
Jul 23 12:10:57.250034 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:57.249945    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:57.312232 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:57.312198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:57.382890 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:57.382854    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:58.086269 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:58.086237    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:58.184648 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:58.184610    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:58.285323 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:58.285297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:58.679702 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:58.679664    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:58.779585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:58.779556    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:58.979315 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:58.979284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:59.038363 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.038336    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-992xp"
Jul 23 12:10:59.073994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.073967    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:59.152449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.152419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:10:59.152642 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:59.152574    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:59.152707 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:59.152643    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls podName:7709b281-8fb5-44e2-a2db-e8a5d50505cb nodeName:}" failed. No retries permitted until 2026-07-23 12:11:15.152625084 +0000 UTC m=+76.913744413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-d7nq5" (UID: "7709b281-8fb5-44e2-a2db-e8a5d50505cb") : secret "cluster-monitoring-operator-tls" not found
Jul 23 12:10:59.253103 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.253021    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:10:59.253103 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.253084    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:59.253450 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.253120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:10:59.253450 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:59.253223    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 12:10:59.253450 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:59.253251    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:11:15.253235298 +0000 UTC m=+77.014354629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : configmap references non-existent config key: service-ca.crt
Jul 23 12:10:59.253450 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:10:59.253272    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs podName:365a7b42-7e90-4da9-84d0-8546d85da537 nodeName:}" failed. No retries permitted until 2026-07-23 12:11:15.253260345 +0000 UTC m=+77.014379674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs") pod "router-default-7446c55b64-2xtn9" (UID: "365a7b42-7e90-4da9-84d0-8546d85da537") : secret "router-metrics-certs-default" not found
Jul 23 12:10:59.454208 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.454171    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:59.456520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.456502    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/207b2f55-bd62-4d3a-872d-5d73c796184d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-cc5f9\" (UID: \"207b2f55-bd62-4d3a-872d-5d73c796184d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:59.547989 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.547909    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lm26f\""
Jul 23 12:10:59.555525 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.555501    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:59.555624 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.555611    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"
Jul 23 12:10:59.557752 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.557725    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") pod \"image-registry-679d56cf84-lfw28\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") " pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:59.676393 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.676356    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9"]
Jul 23 12:10:59.856301 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.856221    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdbs4\""
Jul 23 12:10:59.864257 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.864227    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:10:59.994700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:10:59.994673    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-679d56cf84-lfw28"]
Jul 23 12:10:59.995585 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:10:59.995563    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaceee503_0fbf_409f_aa5f_a7ade42bf54a.slice/crio-51dbe4695ce4f1e4ea4c8f1cb4b2a60812c236442616cfcf968a1f0ed921bca3 WatchSource:0}: Error finding container 51dbe4695ce4f1e4ea4c8f1cb4b2a60812c236442616cfcf968a1f0ed921bca3: Status 404 returned error can't find the container with id 51dbe4695ce4f1e4ea4c8f1cb4b2a60812c236442616cfcf968a1f0ed921bca3
Jul 23 12:11:00.054272 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.054245    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:00.133062 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.132962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679d56cf84-lfw28" event={"ID":"aceee503-0fbf-409f-aa5f-a7ade42bf54a","Type":"ContainerStarted","Data":"1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf"}
Jul 23 12:11:00.133062 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.133061    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679d56cf84-lfw28" event={"ID":"aceee503-0fbf-409f-aa5f-a7ade42bf54a","Type":"ContainerStarted","Data":"51dbe4695ce4f1e4ea4c8f1cb4b2a60812c236442616cfcf968a1f0ed921bca3"}
Jul 23 12:11:00.133267 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.133087    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:11:00.134257 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.134234    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9" event={"ID":"207b2f55-bd62-4d3a-872d-5d73c796184d","Type":"ContainerStarted","Data":"1b51fd54a1d9efc7416d40da007a890409e6b3b86235bfb44a0de2f1226cd210"}
Jul 23 12:11:00.182406 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.182368    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:00.602837 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.602793    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:00.782094 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.782055    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:00.837051 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.837015    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:00.984625 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:00.984590    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:01.385128 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:01.385015    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:01.990447 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:01.990364    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:02.140944 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:02.140860    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9" event={"ID":"207b2f55-bd62-4d3a-872d-5d73c796184d","Type":"ContainerStarted","Data":"6ae7bb8a345d04d2d29f580d5e81ae32465186658c047418e5661185562a5117"}
Jul 23 12:11:02.140944 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:02.140915    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9" event={"ID":"207b2f55-bd62-4d3a-872d-5d73c796184d","Type":"ContainerStarted","Data":"19607c6cd74a558a03414b30c39d05d8957f833936454999ca5da4fefed87bbc"}
Jul 23 12:11:02.163307 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:02.163260    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-679d56cf84-lfw28" podStartSLOduration=19.163244356 podStartE2EDuration="19.163244356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:00.160142363 +0000 UTC m=+61.921261716" watchObservedRunningTime="2026-07-23 12:11:02.163244356 +0000 UTC m=+63.924363707"
Jul 23 12:11:02.398205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:02.398123    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:02.598598 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:02.598545    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:02.794001 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:02.793964    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:03.221348 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.221322    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:03.278711 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.278682    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:03.386627 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.386587    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:11:03.389536 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.389521    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 12:11:03.399893 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.399870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5245d445-4d3c-4f7d-94ea-c11197612fc9-metrics-certs\") pod \"network-metrics-daemon-cnjvr\" (UID: \"5245d445-4d3c-4f7d-94ea-c11197612fc9\") " pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:11:03.487829 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.487751    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:11:03.490643 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.490625    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 12:11:03.500066 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.500043    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa7e528-7695-4a0e-a325-956ff07acf09-original-pull-secret\") pod \"global-pull-secret-syncer-nhxhc\" (UID: \"2fa7e528-7695-4a0e-a325-956ff07acf09\") " pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:11:03.587285 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.587260    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:03.588149 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.588128    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:11:03.590447 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.590428    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 12:11:03.600734 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.600714    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 12:11:03.611015 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.610995    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs577\" (UniqueName: \"kubernetes.io/projected/913714e7-afa4-4619-95ea-58ebf7a87df2-kube-api-access-gs577\") pod \"network-check-target-dqxkg\" (UID: \"913714e7-afa4-4619-95ea-58ebf7a87df2\") " pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:11:03.645425 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.645398    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k5z96\""
Jul 23 12:11:03.650708 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.650692    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pbg55\""
Jul 23 12:11:03.653647 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.653632    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cnjvr"
Jul 23 12:11:03.653701 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.653647    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhxhc"
Jul 23 12:11:03.658513 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.658493    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:11:03.795803 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.795765    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:03.798697 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.798652    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-cc5f9" podStartSLOduration=18.661217033 podStartE2EDuration="20.798637018s" totalImagesPullingTime="2.137419985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:02.162930242 +0000 UTC m=+63.924049606" watchObservedRunningTime="2026-07-23 12:11:03.798637018 +0000 UTC m=+65.559756346"
Jul 23 12:11:03.798924 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:03.798912    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhxhc"]
Jul 23 12:11:03.801688 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:03.801664    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa7e528_7695_4a0e_a325_956ff07acf09.slice/crio-0a952e0b616c3129143a746d1a3a68dfcf403ac3e545c118424df9178c84699e WatchSource:0}: Error finding container 0a952e0b616c3129143a746d1a3a68dfcf403ac3e545c118424df9178c84699e: Status 404 returned error can't find the container with id 0a952e0b616c3129143a746d1a3a68dfcf403ac3e545c118424df9178c84699e
Jul 23 12:11:04.026556 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.026398    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cnjvr"]
Jul 23 12:11:04.029198 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:04.029159    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5245d445_4d3c_4f7d_94ea_c11197612fc9.slice/crio-030375fe5150302fc77806d9fd70741805ecbea332bc0271d18f57f090109626 WatchSource:0}: Error finding container 030375fe5150302fc77806d9fd70741805ecbea332bc0271d18f57f090109626: Status 404 returned error can't find the container with id 030375fe5150302fc77806d9fd70741805ecbea332bc0271d18f57f090109626
Jul 23 12:11:04.030067 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.030046    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqxkg"]
Jul 23 12:11:04.033562 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:04.033526    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913714e7_afa4_4619_95ea_58ebf7a87df2.slice/crio-31d9cabfc16dfbf19bb7057d2148f88e71b01d6154929106c87cdca8759197d4 WatchSource:0}: Error finding container 31d9cabfc16dfbf19bb7057d2148f88e71b01d6154929106c87cdca8759197d4: Status 404 returned error can't find the container with id 31d9cabfc16dfbf19bb7057d2148f88e71b01d6154929106c87cdca8759197d4
Jul 23 12:11:04.147952 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.147921    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqxkg" event={"ID":"913714e7-afa4-4619-95ea-58ebf7a87df2","Type":"ContainerStarted","Data":"31d9cabfc16dfbf19bb7057d2148f88e71b01d6154929106c87cdca8759197d4"}
Jul 23 12:11:04.148998 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.148970    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhxhc" event={"ID":"2fa7e528-7695-4a0e-a325-956ff07acf09","Type":"ContainerStarted","Data":"0a952e0b616c3129143a746d1a3a68dfcf403ac3e545c118424df9178c84699e"}
Jul 23 12:11:04.150099 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.150079    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cnjvr" event={"ID":"5245d445-4d3c-4f7d-94ea-c11197612fc9","Type":"ContainerStarted","Data":"030375fe5150302fc77806d9fd70741805ecbea332bc0271d18f57f090109626"}
Jul 23 12:11:04.189835 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.189795    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:04.496362 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.496326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:11:04.499016 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.498933    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f481be-e4e0-45c9-8234-fa269d200260-metrics-tls\") pod \"dns-default-6h9pt\" (UID: \"a8f481be-e4e0-45c9-8234-fa269d200260\") " pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:11:04.783230 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.783123    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dbmrb\""
Jul 23 12:11:04.791224 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.791194    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:11:04.792422 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.792399    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:04.946604 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.946568    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6h9pt"]
Jul 23 12:11:04.953039 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:04.952820    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f481be_e4e0_45c9_8234_fa269d200260.slice/crio-ebb0872b171ef108eb348458a6556a21e3c8100e1682e92408cf7d0b63f6cc75 WatchSource:0}: Error finding container ebb0872b171ef108eb348458a6556a21e3c8100e1682e92408cf7d0b63f6cc75: Status 404 returned error can't find the container with id ebb0872b171ef108eb348458a6556a21e3c8100e1682e92408cf7d0b63f6cc75
Jul 23 12:11:04.977849 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:04.977815    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:05.155346 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.155252    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6h9pt" event={"ID":"a8f481be-e4e0-45c9-8234-fa269d200260","Type":"ContainerStarted","Data":"ebb0872b171ef108eb348458a6556a21e3c8100e1682e92408cf7d0b63f6cc75"}
Jul 23 12:11:05.187305 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.187272    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:05.202436 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.202393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:11:05.202613 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.202514    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:11:05.203088 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.203055    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9a392ff-04c5-4877-8217-0cb6622a71b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:11:05.206055 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.206032    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9a392ff-04c5-4877-8217-0cb6622a71b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pd9r4\" (UID: \"d9a392ff-04c5-4877-8217-0cb6622a71b5\") " pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:11:05.310290 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.310256    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l7bff\""
Jul 23 12:11:05.318566 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.318539    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pd9r4"
Jul 23 12:11:05.716165 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.716118    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:05.812083 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.812065    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pd9r4"]
Jul 23 12:11:05.814149 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:05.814124    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:05.815609 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:05.815582    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a392ff_04c5_4877_8217_0cb6622a71b5.slice/crio-c0c3ce4aee67fececef30998097873b977490bb3bd103686d195bec5f959a4b1 WatchSource:0}: Error finding container c0c3ce4aee67fececef30998097873b977490bb3bd103686d195bec5f959a4b1: Status 404 returned error can't find the container with id c0c3ce4aee67fececef30998097873b977490bb3bd103686d195bec5f959a4b1
Jul 23 12:11:06.164726 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:06.164641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cnjvr" event={"ID":"5245d445-4d3c-4f7d-94ea-c11197612fc9","Type":"ContainerStarted","Data":"d8d7be39fd55d8b64eda942f2f620574510f3675c3ca1271c90c2a2b3240d1c6"}
Jul 23 12:11:06.164726 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:06.164709    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cnjvr" event={"ID":"5245d445-4d3c-4f7d-94ea-c11197612fc9","Type":"ContainerStarted","Data":"87be7a0edbb5c8a524b57c30be350ce7a75eaf85a2b510a4dafe252cfa5c024c"}
Jul 23 12:11:06.166387 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:06.166318    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pd9r4" event={"ID":"d9a392ff-04c5-4877-8217-0cb6622a71b5","Type":"ContainerStarted","Data":"c0c3ce4aee67fececef30998097873b977490bb3bd103686d195bec5f959a4b1"}
Jul 23 12:11:06.185311 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:06.184963    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cnjvr" podStartSLOduration=66.510202867 podStartE2EDuration="1m8.18494514s" totalImagesPullingTime="1.674742273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:06.183751446 +0000 UTC m=+67.944870797" watchObservedRunningTime="2026-07-23 12:11:06.18494514 +0000 UTC m=+67.946064492"
Jul 23 12:11:06.733404 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:06.733373    2570 scope.go:117] "RemoveContainer" containerID="37fa2fa706a104d14c796066385c754936e3e1a3a43b40e89bbd1022ce1409b2"
Jul 23 12:11:12.553887 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.553808    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-679d56cf84-lfw28"]
Jul 23 12:11:12.586456 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.586425    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:12.595887 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.595861    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-765cd699df-bdpfl"]
Jul 23 12:11:12.599579 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.599563    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.613649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.613623    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-765cd699df-bdpfl"]
Jul 23 12:11:12.666684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.666324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcm9s\" (UniqueName: \"kubernetes.io/projected/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-kube-api-access-mcm9s\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.666684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.666377    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-bound-sa-token\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.666684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.666413    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-installation-pull-secrets\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.666684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.666448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-registry-tls\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.666684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.666513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-registry-certificates\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.666684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.666538    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-trusted-ca\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.666684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.666579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-image-registry-private-configuration\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.666684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.666638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-ca-trust-extracted\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.679527 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.678502    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:12.767742 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.767664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcm9s\" (UniqueName: \"kubernetes.io/projected/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-kube-api-access-mcm9s\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.767742 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.767725    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-bound-sa-token\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.767938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.767760    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-installation-pull-secrets\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.767996 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.767955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-registry-tls\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.768050 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.768026    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-registry-certificates\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.768100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.768051    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-trusted-ca\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.768100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.768092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-image-registry-private-configuration\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.768576 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.768158    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-ca-trust-extracted\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.768656 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.768622    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-ca-trust-extracted\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.770488 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.769451    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-trusted-ca\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.770488 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.769708    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-registry-certificates\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.772997 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.772941    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-image-registry-private-configuration\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.773245 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.773199    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-registry-tls\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.773603 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.773565    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-installation-pull-secrets\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.775181 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.775118    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:12.780814 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.780772    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-bound-sa-token\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.780915 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.780884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcm9s\" (UniqueName: \"kubernetes.io/projected/9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1-kube-api-access-mcm9s\") pod \"image-registry-765cd699df-bdpfl\" (UID: \"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1\") " pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:12.874310 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.874182    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:12.943272 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:12.943236    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:13.072609 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.072582    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-765cd699df-bdpfl"]
Jul 23 12:11:13.075240 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:13.075213    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed25b61_c5c2_441b_bbf4_a8eedff5f6a1.slice/crio-1841d6f3a2dcf81b63b861947976e5f5649e0349ee2140bb8a517cf2bc9aa5e7 WatchSource:0}: Error finding container 1841d6f3a2dcf81b63b861947976e5f5649e0349ee2140bb8a517cf2bc9aa5e7: Status 404 returned error can't find the container with id 1841d6f3a2dcf81b63b861947976e5f5649e0349ee2140bb8a517cf2bc9aa5e7
Jul 23 12:11:13.196390 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.196359    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:11:13.196601 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.196465    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs" event={"ID":"ec546b3e-11ce-42a8-9482-a9103f11490d","Type":"ContainerStarted","Data":"eb52e88450c780c89d74bed3af1389951183257ccf4325dedf4426c8431e44a3"}
Jul 23 12:11:13.197458 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.197414    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:11:13.201072 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.200973    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhxhc" event={"ID":"2fa7e528-7695-4a0e-a325-956ff07acf09","Type":"ContainerStarted","Data":"238fe773d51c2b92cc4ca2a686e64cafcc1ddeea9552e99fcfc6f2e6f80c1703"}
Jul 23 12:11:13.204100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.204075    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6h9pt" event={"ID":"a8f481be-e4e0-45c9-8234-fa269d200260","Type":"ContainerStarted","Data":"9f97a769f5d3edf4893b487021f8ceb29bbc0788dfe3d4b2f3544c56fd5367fc"}
Jul 23 12:11:13.204217 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.204125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6h9pt" event={"ID":"a8f481be-e4e0-45c9-8234-fa269d200260","Type":"ContainerStarted","Data":"719287a525601b00a6a2031d14b084f571329323514fe929bbf2a102b5fb589c"}
Jul 23 12:11:13.204688 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.204668    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:11:13.210945 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.210920    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pd9r4" event={"ID":"d9a392ff-04c5-4877-8217-0cb6622a71b5","Type":"ContainerStarted","Data":"df4e153e5959679c12af38be2af15b60721fad969a1e3ad8c833b76bddd71265"}
Jul 23 12:11:13.213033 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.213015    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs"
Jul 23 12:11:13.214761 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.214737    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-765cd699df-bdpfl" event={"ID":"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1","Type":"ContainerStarted","Data":"a3a81207853452c87df70baedc2507274e50e9dad519c42d542e7ae7b2a15ab6"}
Jul 23 12:11:13.214853 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.214780    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-765cd699df-bdpfl" event={"ID":"9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1","Type":"ContainerStarted","Data":"1841d6f3a2dcf81b63b861947976e5f5649e0349ee2140bb8a517cf2bc9aa5e7"}
Jul 23 12:11:13.215192 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.215141    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:13.219586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.217958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqxkg" event={"ID":"913714e7-afa4-4619-95ea-58ebf7a87df2","Type":"ContainerStarted","Data":"0f5b38bf46fc5dcd29ab37609732a943a58bba9f7b0dcc392420f0921c2c0a60"}
Jul 23 12:11:13.219586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.218391    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:11:13.232056 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.231955    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-b2ccs" podStartSLOduration=27.823226884 podStartE2EDuration="30.231935529s" totalImagesPullingTime="2.408708645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:13.230505128 +0000 UTC m=+74.991624479" watchObservedRunningTime="2026-07-23 12:11:13.231935529 +0000 UTC m=+74.993054881"
Jul 23 12:11:13.255395 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.255333    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dqxkg" podStartSLOduration=67.037263919 podStartE2EDuration="1m15.255314111s" totalImagesPullingTime="8.218050192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:13.253150991 +0000 UTC m=+75.014270343" watchObservedRunningTime="2026-07-23 12:11:13.255314111 +0000 UTC m=+75.016433463"
Jul 23 12:11:13.280067 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.280012    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6h9pt" podStartSLOduration=33.648367497 podStartE2EDuration="41.279991969s" totalImagesPullingTime="7.631624472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:13.278303534 +0000 UTC m=+75.039422886" watchObservedRunningTime="2026-07-23 12:11:13.279991969 +0000 UTC m=+75.041111321"
Jul 23 12:11:13.324972 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.323782    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-765cd699df-bdpfl" podStartSLOduration=1.3237605239999999 podStartE2EDuration="1.323760524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:13.322900617 +0000 UTC m=+75.084019972" watchObservedRunningTime="2026-07-23 12:11:13.323760524 +0000 UTC m=+75.084879877"
Jul 23 12:11:13.353425 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.352634    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nhxhc" podStartSLOduration=66.566766902 podStartE2EDuration="1m15.352611478s" totalImagesPullingTime="8.785844576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:13.351921612 +0000 UTC m=+75.113040963" watchObservedRunningTime="2026-07-23 12:11:13.352611478 +0000 UTC m=+75.113730833"
Jul 23 12:11:13.391139 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.390974    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:13.462560 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.462500    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:13.645606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.645508    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:13.830164 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.830130    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:13.929983 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:13.929864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:14.034985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:14.034947    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:14.224435 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:14.224397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:14.278857 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:14.278791    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:14.649630 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:14.649533    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:14.745869 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:14.745828    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:15.192990 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.192952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:11:15.195414 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.195379    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7709b281-8fb5-44e2-a2db-e8a5d50505cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-d7nq5\" (UID: \"7709b281-8fb5-44e2-a2db-e8a5d50505cb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:11:15.244314 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.244278    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:15.293688 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.293649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:11:15.293862 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.293704    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:11:15.294463 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.294435    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/365a7b42-7e90-4da9-84d0-8546d85da537-service-ca-bundle\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:11:15.296779 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.296758    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365a7b42-7e90-4da9-84d0-8546d85da537-metrics-certs\") pod \"router-default-7446c55b64-2xtn9\" (UID: \"365a7b42-7e90-4da9-84d0-8546d85da537\") " pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:11:15.440428 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.440394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:15.440976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.440958    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2vxmx\""
Jul 23 12:11:15.449403 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.449360    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"
Jul 23 12:11:15.538045 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.538017    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6zl85\""
Jul 23 12:11:15.546338 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.546311    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:11:15.739981 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:15.739923    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:16.083736 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:16.083670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:16.145537 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:16.145500    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:16.267212 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:16.267192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5"]
Jul 23 12:11:16.269529 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:16.269506    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7709b281_8fb5_44e2_a2db_e8a5d50505cb.slice/crio-80548653622d0a9534d6453a1a1986c2169297795314f78967584f79d66f5c49 WatchSource:0}: Error finding container 80548653622d0a9534d6453a1a1986c2169297795314f78967584f79d66f5c49: Status 404 returned error can't find the container with id 80548653622d0a9534d6453a1a1986c2169297795314f78967584f79d66f5c49
Jul 23 12:11:16.284648 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:16.284621    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7446c55b64-2xtn9"]
Jul 23 12:11:16.287723 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:16.287697    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365a7b42_7e90_4da9_84d0_8546d85da537.slice/crio-7c090097f8130883a8ef62fd3189d5ec21b2346974d7958f40d50890b820b628 WatchSource:0}: Error finding container 7c090097f8130883a8ef62fd3189d5ec21b2346974d7958f40d50890b820b628: Status 404 returned error can't find the container with id 7c090097f8130883a8ef62fd3189d5ec21b2346974d7958f40d50890b820b628
Jul 23 12:11:16.391302 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:16.391259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:16.451995 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:16.451956    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:17.234742 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:17.234663    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5" event={"ID":"7709b281-8fb5-44e2-a2db-e8a5d50505cb","Type":"ContainerStarted","Data":"80548653622d0a9534d6453a1a1986c2169297795314f78967584f79d66f5c49"}
Jul 23 12:11:17.236952 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:17.236920    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pd9r4" event={"ID":"d9a392ff-04c5-4877-8217-0cb6622a71b5","Type":"ContainerStarted","Data":"524bf18ffbaa24c8009aeb85fb11fbc277ed08588f8c3bcb5260e459af95a2e4"}
Jul 23 12:11:17.238720 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:17.238684    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7446c55b64-2xtn9" event={"ID":"365a7b42-7e90-4da9-84d0-8546d85da537","Type":"ContainerStarted","Data":"27af0d9afc2233301f3de76361e4966f670da5bd47e1a1f80a2c3543c1be5c6a"}
Jul 23 12:11:17.238846 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:17.238732    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7446c55b64-2xtn9" event={"ID":"365a7b42-7e90-4da9-84d0-8546d85da537","Type":"ContainerStarted","Data":"7c090097f8130883a8ef62fd3189d5ec21b2346974d7958f40d50890b820b628"}
Jul 23 12:11:17.547434 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:17.547356    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:11:17.550355 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:17.550327    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:11:17.573402 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:17.573337    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7446c55b64-2xtn9" podStartSLOduration=34.573316249 podStartE2EDuration="34.573316249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:17.281229804 +0000 UTC m=+79.042349156" watchObservedRunningTime="2026-07-23 12:11:17.573316249 +0000 UTC m=+79.334435601"
Jul 23 12:11:18.242700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:18.242668    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:11:18.244115 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:18.244090    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7446c55b64-2xtn9"
Jul 23 12:11:20.250607 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:20.250571    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5" event={"ID":"7709b281-8fb5-44e2-a2db-e8a5d50505cb","Type":"ContainerStarted","Data":"bae090b25f76f93a901ae6709eb5daa95567558ca2715904c8c2d3c23351062c"}
Jul 23 12:11:20.252714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:20.252677    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pd9r4" event={"ID":"d9a392ff-04c5-4877-8217-0cb6622a71b5","Type":"ContainerStarted","Data":"03d58caf154a5424e7aecd21d90cc25906a3648607d179a1108839e14590b5e2"}
Jul 23 12:11:20.271623 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:20.271574    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-d7nq5" podStartSLOduration=33.515450994 podStartE2EDuration="37.271555783s" totalImagesPullingTime="3.756104789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:20.270583007 +0000 UTC m=+82.031702384" watchObservedRunningTime="2026-07-23 12:11:20.271555783 +0000 UTC m=+82.032675136"
Jul 23 12:11:20.290744 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:20.290672    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pd9r4" podStartSLOduration=17.24257269 podStartE2EDuration="31.29065973s" totalImagesPullingTime="14.04808704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:10:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:20.289724641 +0000 UTC m=+82.050844033" watchObservedRunningTime="2026-07-23 12:11:20.29065973 +0000 UTC m=+82.051779083"
Jul 23 12:11:20.390410 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:20.390377    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:20.488087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:20.488053    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:20.570355 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:20.570256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:21.192392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:21.192257    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:21.522400 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:21.522366    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:21.580385 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:21.580352    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:21.635411 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:21.635382    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:22.488253 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:22.488216    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:22.546027 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:22.545994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:22.559562 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:22.559541    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:11:23.086954 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:23.086921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:24.229098 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.229058    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6h9pt"
Jul 23 12:11:24.597414 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.597343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:24.647587 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.647550    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"]
Jul 23 12:11:24.651866 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.651846    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.654144 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.654122    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 12:11:24.654276 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.654258    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 12:11:24.655011 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.654997    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 12:11:24.655103 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.655026    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hvzgb\""
Jul 23 12:11:24.659582 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.659563    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"]
Jul 23 12:11:24.666447 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.666421    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:24.771699 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.771671    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4717611e-3b71-41f1-b44b-f0252e12e4da-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.771881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.771716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64rzn\" (UniqueName: \"kubernetes.io/projected/4717611e-3b71-41f1-b44b-f0252e12e4da-kube-api-access-64rzn\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.771881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.771750    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4717611e-3b71-41f1-b44b-f0252e12e4da-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.771881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.771828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4717611e-3b71-41f1-b44b-f0252e12e4da-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.855675 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.855585    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:24.872589 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.872564    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64rzn\" (UniqueName: \"kubernetes.io/projected/4717611e-3b71-41f1-b44b-f0252e12e4da-kube-api-access-64rzn\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.872692 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.872600    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4717611e-3b71-41f1-b44b-f0252e12e4da-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.872692 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.872625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4717611e-3b71-41f1-b44b-f0252e12e4da-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.872692 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.872662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4717611e-3b71-41f1-b44b-f0252e12e4da-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.873311 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.873290    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4717611e-3b71-41f1-b44b-f0252e12e4da-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.874926 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.874903    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4717611e-3b71-41f1-b44b-f0252e12e4da-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.875026 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.874981    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4717611e-3b71-41f1-b44b-f0252e12e4da-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.886260 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.886238    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64rzn\" (UniqueName: \"kubernetes.io/projected/4717611e-3b71-41f1-b44b-f0252e12e4da-kube-api-access-64rzn\") pod \"prometheus-operator-5945b5cfd-zfjv2\" (UID: \"4717611e-3b71-41f1-b44b-f0252e12e4da\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:24.961488 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:24.961427    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"
Jul 23 12:11:25.097137 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:25.097101    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2"]
Jul 23 12:11:25.099772 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:25.099745    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4717611e_3b71_41f1_b44b_f0252e12e4da.slice/crio-ff6f4b896de78dc510635ee75a4550cb6b0985b3490880f75cb86b043ed6836b WatchSource:0}: Error finding container ff6f4b896de78dc510635ee75a4550cb6b0985b3490880f75cb86b043ed6836b: Status 404 returned error can't find the container with id ff6f4b896de78dc510635ee75a4550cb6b0985b3490880f75cb86b043ed6836b
Jul 23 12:11:25.245189 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:25.245156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:25.273362 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:25.273334    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2" event={"ID":"4717611e-3b71-41f1-b44b-f0252e12e4da","Type":"ContainerStarted","Data":"ff6f4b896de78dc510635ee75a4550cb6b0985b3490880f75cb86b043ed6836b"}
Jul 23 12:11:25.305258 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:25.305229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:26.894921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:26.894889    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:27.282247 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:27.282210    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2" event={"ID":"4717611e-3b71-41f1-b44b-f0252e12e4da","Type":"ContainerStarted","Data":"418b9376222ecb2d184b7383da66d9e446247fb2fda3a5aff044d46041f8cc53"}
Jul 23 12:11:27.282454 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:27.282262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2" event={"ID":"4717611e-3b71-41f1-b44b-f0252e12e4da","Type":"ContainerStarted","Data":"07fe7320489a4ba8f92234da2aaa7a64498a47be1f2ccc7a9c156861808707e0"}
Jul 23 12:11:27.301532 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:27.301456    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zfjv2" podStartSLOduration=1.939031975 podStartE2EDuration="3.301439831s" totalImagesPullingTime="1.362407856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:27.300855093 +0000 UTC m=+89.061974444" watchObservedRunningTime="2026-07-23 12:11:27.301439831 +0000 UTC m=+89.062559184"
Jul 23 12:11:27.549550 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:27.549442    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:27.603439 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:27.603405    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:28.778806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:28.778762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:28.991761 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:28.991725    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:29.034535 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.034438    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t6rfc"]
Jul 23 12:11:29.037939 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.037907    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.040494 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.040453    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sc6d5\""
Jul 23 12:11:29.040637 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.040619    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 12:11:29.040702 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.040676    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 12:11:29.040761 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.040735    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 12:11:29.082011 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.081971    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:29.106022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.105985    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-tls\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.106214 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.106046    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/231a8367-faaa-47c9-a74b-eea995b30ddb-root\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.106214 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.106079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-textfile\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.106214 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.106105    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/231a8367-faaa-47c9-a74b-eea995b30ddb-sys\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.106214 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.106135    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.106214 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.106185    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b9gm\" (UniqueName: \"kubernetes.io/projected/231a8367-faaa-47c9-a74b-eea995b30ddb-kube-api-access-2b9gm\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.106385 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.106234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-wtmp\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.106385 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.106260    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/231a8367-faaa-47c9-a74b-eea995b30ddb-metrics-client-ca\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.106385 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.106278    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-accelerators-collector-config\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.158860 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.158827    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:29.207525 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-tls\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207555    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/231a8367-faaa-47c9-a74b-eea995b30ddb-root\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207585    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-textfile\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/231a8367-faaa-47c9-a74b-eea995b30ddb-sys\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207672    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/231a8367-faaa-47c9-a74b-eea995b30ddb-sys\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/231a8367-faaa-47c9-a74b-eea995b30ddb-root\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207765    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b9gm\" (UniqueName: \"kubernetes.io/projected/231a8367-faaa-47c9-a74b-eea995b30ddb-kube-api-access-2b9gm\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207789    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-wtmp\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207817    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/231a8367-faaa-47c9-a74b-eea995b30ddb-metrics-client-ca\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.207953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-accelerators-collector-config\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.208159 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.207950    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-wtmp\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.208159 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.208010    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-textfile\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.208596 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.208556    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/231a8367-faaa-47c9-a74b-eea995b30ddb-metrics-client-ca\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.208716 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.208699    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-accelerators-collector-config\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.210479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.210447    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.210624 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.210606    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/231a8367-faaa-47c9-a74b-eea995b30ddb-node-exporter-tls\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.218860 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.218835    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b9gm\" (UniqueName: \"kubernetes.io/projected/231a8367-faaa-47c9-a74b-eea995b30ddb-kube-api-access-2b9gm\") pod \"node-exporter-t6rfc\" (UID: \"231a8367-faaa-47c9-a74b-eea995b30ddb\") " pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.272561 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.272523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:29.347813 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.347727    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t6rfc"
Jul 23 12:11:29.359182 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:29.359131    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231a8367_faaa_47c9_a74b_eea995b30ddb.slice/crio-44272b0933e6b56b032cf3d95054a8f602310e3e6d9fa6a9eb32ae5184698074 WatchSource:0}: Error finding container 44272b0933e6b56b032cf3d95054a8f602310e3e6d9fa6a9eb32ae5184698074: Status 404 returned error can't find the container with id 44272b0933e6b56b032cf3d95054a8f602310e3e6d9fa6a9eb32ae5184698074
Jul 23 12:11:29.359321 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.359297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:29.498250 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.498217    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:29.598632 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.598541    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:29.702801 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.702766    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:29.801301 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:29.801268    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:30.002601 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.002559    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:30.127370 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.127331    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 12:11:30.129963 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.129937    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:30.131768 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.131747    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.134502 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.134458    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 12:11:30.134624 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.134506    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 12:11:30.135182 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.134967    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v945x\""
Jul 23 12:11:30.135182 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.134979    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 12:11:30.135182 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.134999    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 12:11:30.135182 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.135044    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 12:11:30.135182 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.134999    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 12:11:30.135434 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.135317    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 12:11:30.135434 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.135361    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 12:11:30.135569 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.135547    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 12:11:30.150002 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.149972    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 12:11:30.217396 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.217396 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.217634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-web-config\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.217634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47j9b\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-kube-api-access-47j9b\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.217634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-config-out\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.217634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217555    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-config-volume\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.217634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.217634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217597    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.217634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217618    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.218004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217652    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.218004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217710    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.218004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217729    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.218004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.217748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.295113 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.295016    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6rfc" event={"ID":"231a8367-faaa-47c9-a74b-eea995b30ddb","Type":"ContainerStarted","Data":"44272b0933e6b56b032cf3d95054a8f602310e3e6d9fa6a9eb32ae5184698074"}
Jul 23 12:11:30.318556 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318515    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-web-config\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318723 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47j9b\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-kube-api-access-47j9b\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318723 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318601    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-config-out\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318723 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-config-volume\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318723 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318666    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318723 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318723 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318720    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318966 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318745    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318966 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318782    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318966 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318809    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318966 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318966 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318874    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.318966 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.318897    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.319327 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:11:30.319305    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-trusted-ca-bundle podName:9961ed0c-58fa-4cba-b4b0-162487413071 nodeName:}" failed. No retries permitted until 2026-07-23 12:11:30.81928189 +0000 UTC m=+92.580401221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071") : configmap references non-existent config key: ca-bundle.crt
Jul 23 12:11:30.320248 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.320223    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.320541 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.320512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.327254 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.327227    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-web-config\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.327361 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.327269    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.327545 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.327523    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.328073 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.328051    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.328227 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.328204    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-config-out\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.328563 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.328526    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.328668 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.328561    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.328731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.328685    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-config-volume\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.328731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.328706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.337129 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.337103    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47j9b\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-kube-api-access-47j9b\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.360111 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.360026    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:30.824570 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.824460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:30.825201 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:30.825177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:31.044251 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.044208    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:11:31.175387 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.175343    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"]
Jul 23 12:11:31.179835 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.179815    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.182370 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.182350    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 23 12:11:31.182552 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.182397    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-45k4r\""
Jul 23 12:11:31.182552 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.182437    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a5gs80phu07ka\""
Jul 23 12:11:31.182990 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.182975    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 23 12:11:31.183050 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.183037    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 23 12:11:31.183260 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.183244    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 23 12:11:31.183301 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.183257    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 23 12:11:31.191566 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.191539    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"]
Jul 23 12:11:31.193268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.193248    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 12:11:31.195632 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:31.195610    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9961ed0c_58fa_4cba_b4b0_162487413071.slice/crio-ed04ac73acbdc0f5a57e0ae49a9f0d463b2914ecfd12fa15760c5640f2925fcc WatchSource:0}: Error finding container ed04ac73acbdc0f5a57e0ae49a9f0d463b2914ecfd12fa15760c5640f2925fcc: Status 404 returned error can't find the container with id ed04ac73acbdc0f5a57e0ae49a9f0d463b2914ecfd12fa15760c5640f2925fcc
Jul 23 12:11:31.299807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.299766    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerStarted","Data":"ed04ac73acbdc0f5a57e0ae49a9f0d463b2914ecfd12fa15760c5640f2925fcc"}
Jul 23 12:11:31.301249 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.301227    2570 generic.go:356] "Generic (PLEG): container finished" podID="231a8367-faaa-47c9-a74b-eea995b30ddb" containerID="8d7d8b1f1afb21fd45622da663d3488e1c67c83d0abd627aa878c2c971a7d0ee" exitCode=0
Jul 23 12:11:31.301352 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.301273    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6rfc" event={"ID":"231a8367-faaa-47c9-a74b-eea995b30ddb","Type":"ContainerDied","Data":"8d7d8b1f1afb21fd45622da663d3488e1c67c83d0abd627aa878c2c971a7d0ee"}
Jul 23 12:11:31.328255 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.328218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.328364 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.328268    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-tls\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.328364 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.328296    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c2jj\" (UniqueName: \"kubernetes.io/projected/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-kube-api-access-9c2jj\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.328498 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.328358    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.328498 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.328399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-metrics-client-ca\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.328498 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.328426    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.328498 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.328464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.328712 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.328602    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-grpc-tls\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.429271 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.429237    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.429389 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.429326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-tls\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.429389 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.429351    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c2jj\" (UniqueName: \"kubernetes.io/projected/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-kube-api-access-9c2jj\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.429530 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.429388    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.429530 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.429487    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-metrics-client-ca\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.429633 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.429539    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.429633 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.429580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.429633 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.429616    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-grpc-tls\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.431138 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.431111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-metrics-client-ca\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.432578 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.432549    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.432698 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.432609    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.432698 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.432628    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-grpc-tls\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.432814 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.432727    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-tls\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.433155 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.433136    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.433214 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.433180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.442650 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.442572    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c2jj\" (UniqueName: \"kubernetes.io/projected/b4b98f03-ec22-4a68-b05e-88ef74fbe38f-kube-api-access-9c2jj\") pod \"thanos-querier-95f4b9bcf-twrwl\" (UID: \"b4b98f03-ec22-4a68-b05e-88ef74fbe38f\") " pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.489815 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.489785    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:31.624337 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:31.624248    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"]
Jul 23 12:11:31.627649 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:31.627620    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b98f03_ec22_4a68_b05e_88ef74fbe38f.slice/crio-11791bd707d12fd6751f7ac22a1e7724f7718cdd2dfdba2326ebb176c2ac6683 WatchSource:0}: Error finding container 11791bd707d12fd6751f7ac22a1e7724f7718cdd2dfdba2326ebb176c2ac6683: Status 404 returned error can't find the container with id 11791bd707d12fd6751f7ac22a1e7724f7718cdd2dfdba2326ebb176c2ac6683
Jul 23 12:11:32.016212 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:32.016174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:32.116904 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:32.116865    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:32.272126 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:32.272098    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:32.308395 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:32.308366    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6rfc" event={"ID":"231a8367-faaa-47c9-a74b-eea995b30ddb","Type":"ContainerStarted","Data":"c346a3e2add0dbfd34746e61a45316a96197a5964aed13db9b883cb218fdd75e"}
Jul 23 12:11:32.308525 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:32.308427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6rfc" event={"ID":"231a8367-faaa-47c9-a74b-eea995b30ddb","Type":"ContainerStarted","Data":"9cd8bf810bcd41ac095979236cb51a11359dd8c3fd3e07153e95f9f02632863b"}
Jul 23 12:11:32.309765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:32.309740    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl" event={"ID":"b4b98f03-ec22-4a68-b05e-88ef74fbe38f","Type":"ContainerStarted","Data":"11791bd707d12fd6751f7ac22a1e7724f7718cdd2dfdba2326ebb176c2ac6683"}
Jul 23 12:11:32.333134 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:32.333041    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t6rfc" podStartSLOduration=2.138332607 podStartE2EDuration="3.333025288s" totalImagesPullingTime="1.129896395s" totalInitContainerRuntime="64.796286ms" isStatefulPod=true podCreationTimestamp="2026-07-23 12:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:32.331883876 +0000 UTC m=+94.093003229" watchObservedRunningTime="2026-07-23 12:11:32.333025288 +0000 UTC m=+94.094144638"
Jul 23 12:11:32.337159 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:32.337130    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:32.533261 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:32.533169    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:33.232255 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:33.232223    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:33.316577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:33.316541    2570 generic.go:356] "Generic (PLEG): container finished" podID="9961ed0c-58fa-4cba-b4b0-162487413071" containerID="7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397" exitCode=0
Jul 23 12:11:33.316749 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:33.316609    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerDied","Data":"7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397"}
Jul 23 12:11:33.395019 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:33.394981    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:33.512386 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:33.512291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:33.827521 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:33.827496    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:33.938981 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:33.938890    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:34.228807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:34.228775    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-765cd699df-bdpfl"
Jul 23 12:11:34.324995 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:34.324948    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl" event={"ID":"b4b98f03-ec22-4a68-b05e-88ef74fbe38f","Type":"ContainerStarted","Data":"0f9ec1dd2cee196a3020e0e023fc49f4fd9ef3c53f65c1e1c2b1c829fdb42319"}
Jul 23 12:11:34.325379 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:34.325072    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl" event={"ID":"b4b98f03-ec22-4a68-b05e-88ef74fbe38f","Type":"ContainerStarted","Data":"383ea8c6406285d78db00460450a0220451c68091b1150e1186cb300606a81e1"}
Jul 23 12:11:34.325379 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:34.325100    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl" event={"ID":"b4b98f03-ec22-4a68-b05e-88ef74fbe38f","Type":"ContainerStarted","Data":"eef338cd9ecd70f4efc65e3284fa1d1dcb5f2ce75c399049e0e1f7fe8f10aa11"}
Jul 23 12:11:34.357936 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:34.357889    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:34.459042 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:34.459010    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:34.559417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:34.559314    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:34.659318 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:34.659271    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:35.332316 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:35.331921    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerStarted","Data":"b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d"}
Jul 23 12:11:35.336432 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:35.336400    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl" event={"ID":"b4b98f03-ec22-4a68-b05e-88ef74fbe38f","Type":"ContainerStarted","Data":"0de7c3b62de03963b644aaaebef01325dad463a6e873ca26d864471aa34440ba"}
Jul 23 12:11:35.336607 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:35.336498    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl" event={"ID":"b4b98f03-ec22-4a68-b05e-88ef74fbe38f","Type":"ContainerStarted","Data":"3bead65ce88e43577a7656d42f95534a3ba74aacbf15b5292069c798c3acc5be"}
Jul 23 12:11:35.435297 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:35.435205    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:35.714432 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:35.714386    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:35.816583 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:35.816545    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:36.342855 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:36.342822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerStarted","Data":"093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579"}
Jul 23 12:11:36.343268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:36.342891    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerStarted","Data":"106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a"}
Jul 23 12:11:36.343268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:36.342929    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerStarted","Data":"154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c"}
Jul 23 12:11:36.343268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:36.342968    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerStarted","Data":"41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8"}
Jul 23 12:11:36.343268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:36.343001    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerStarted","Data":"0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf"}
Jul 23 12:11:36.345671 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:36.345649    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl" event={"ID":"b4b98f03-ec22-4a68-b05e-88ef74fbe38f","Type":"ContainerStarted","Data":"5d4b32f434da4adcbc2d1c941735c9ead62509ec4e68fc396b651b5261752cbc"}
Jul 23 12:11:36.345791 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:36.345775    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:36.372496 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:36.372415    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.43546002 podStartE2EDuration="6.372397221s" totalImagesPullingTime="2.921243051s" totalInitContainerRuntime="15.69415ms" isStatefulPod=false podCreationTimestamp="2026-07-23 12:11:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:36.371198173 +0000 UTC m=+98.132317526" watchObservedRunningTime="2026-07-23 12:11:36.372397221 +0000 UTC m=+98.133516572"
Jul 23 12:11:36.396955 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:36.396488    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl" podStartSLOduration=2.03522427 podStartE2EDuration="5.396449923s" totalImagesPullingTime="3.361225653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:11:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:36.394235122 +0000 UTC m=+98.155354490" watchObservedRunningTime="2026-07-23 12:11:36.396449923 +0000 UTC m=+98.157569276"
Jul 23 12:11:37.331860 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.331822    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65cd7d5f55-d8x87"]
Jul 23 12:11:37.335112 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.335094    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.337618 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.337596    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 12:11:37.338298 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.338281    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 12:11:37.338412 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.338338    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 12:11:37.338572 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.338411    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 12:11:37.338669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.338636    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 12:11:37.338743 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.338725    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 12:11:37.338800 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.338737    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 12:11:37.338800 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.338755    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6gcs6\""
Jul 23 12:11:37.342834 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.342552    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 12:11:37.345404 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.345375    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cd7d5f55-d8x87"]
Jul 23 12:11:37.487562 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.487517    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-serving-cert\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.487767 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.487678    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-oauth-serving-cert\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.488010 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.487981    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-service-ca\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.488083 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.488072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-oauth-config\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.488144 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.488128    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z77vl\" (UniqueName: \"kubernetes.io/projected/33896a64-9497-473a-bab5-2cb1293c1475-kube-api-access-z77vl\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.488306 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.488282    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-console-config\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.488374 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.488330    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-trusted-ca-bundle\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.577938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.577896    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-679d56cf84-lfw28" podUID="aceee503-0fbf-409f-aa5f-a7ade42bf54a" containerName="registry" containerID="cri-o://1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf" gracePeriod=30
Jul 23 12:11:37.589774 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.589695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-oauth-config\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.589774 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.589737    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z77vl\" (UniqueName: \"kubernetes.io/projected/33896a64-9497-473a-bab5-2cb1293c1475-kube-api-access-z77vl\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.589900 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.589810    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-console-config\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.589900 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.589841    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-trusted-ca-bundle\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.589998 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.589895    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-serving-cert\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.589998 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.589939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-oauth-serving-cert\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.589998 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.589992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-service-ca\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.590666 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.590640    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-console-config\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.590802 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.590775    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-oauth-serving-cert\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.590802 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.590751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-service-ca\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.591111 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.591091    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-trusted-ca-bundle\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.592210 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.592192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-oauth-config\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.592366 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.592349    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-serving-cert\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.599069 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.599043    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z77vl\" (UniqueName: \"kubernetes.io/projected/33896a64-9497-473a-bab5-2cb1293c1475-kube-api-access-z77vl\") pod \"console-65cd7d5f55-d8x87\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") " pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.646101 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.646063    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:37.849016 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.848990    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:11:37.993700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.993666    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-certificates\") pod \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") "
Jul 23 12:11:37.993856 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.993721    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-bound-sa-token\") pod \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") "
Jul 23 12:11:37.993856 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.993761    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-trusted-ca\") pod \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") "
Jul 23 12:11:37.993991 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.993936    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aceee503-0fbf-409f-aa5f-a7ade42bf54a-ca-trust-extracted\") pod \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") "
Jul 23 12:11:37.993991 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.993983    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-image-registry-private-configuration\") pod \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") "
Jul 23 12:11:37.994088 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.994008    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") pod \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") "
Jul 23 12:11:37.994088 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.994031    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-installation-pull-secrets\") pod \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") "
Jul 23 12:11:37.994088 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.994069    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgst6\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-kube-api-access-qgst6\") pod \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\" (UID: \"aceee503-0fbf-409f-aa5f-a7ade42bf54a\") "
Jul 23 12:11:37.994219 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.994103    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aceee503-0fbf-409f-aa5f-a7ade42bf54a" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:11:37.994489 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.994257    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aceee503-0fbf-409f-aa5f-a7ade42bf54a" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:11:37.997145 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.996956    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aceee503-0fbf-409f-aa5f-a7ade42bf54a" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:11:37.997145 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.997102    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aceee503-0fbf-409f-aa5f-a7ade42bf54a" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:11:37.997307 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.997153    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-kube-api-access-qgst6" (OuterVolumeSpecName: "kube-api-access-qgst6") pod "aceee503-0fbf-409f-aa5f-a7ade42bf54a" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a"). InnerVolumeSpecName "kube-api-access-qgst6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:11:37.997863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.997831    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cd7d5f55-d8x87"]
Jul 23 12:11:37.997953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.997870    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aceee503-0fbf-409f-aa5f-a7ade42bf54a" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:11:37.998272 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:37.998235    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aceee503-0fbf-409f-aa5f-a7ade42bf54a" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:11:38.002324 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:38.002302    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33896a64_9497_473a_bab5_2cb1293c1475.slice/crio-748040dd40a9dc3f491e5756e092c1a9c81463c4de6af9f83a13592b7bf69420 WatchSource:0}: Error finding container 748040dd40a9dc3f491e5756e092c1a9c81463c4de6af9f83a13592b7bf69420: Status 404 returned error can't find the container with id 748040dd40a9dc3f491e5756e092c1a9c81463c4de6af9f83a13592b7bf69420
Jul 23 12:11:38.004037 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.004012    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aceee503-0fbf-409f-aa5f-a7ade42bf54a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aceee503-0fbf-409f-aa5f-a7ade42bf54a" (UID: "aceee503-0fbf-409f-aa5f-a7ade42bf54a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:11:38.095807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.095711    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-bound-sa-token\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:11:38.095807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.095754    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-trusted-ca\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:11:38.095807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.095771    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aceee503-0fbf-409f-aa5f-a7ade42bf54a-ca-trust-extracted\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:11:38.095807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.095786    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-image-registry-private-configuration\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:11:38.095807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.095800    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-tls\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:11:38.095807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.095813    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aceee503-0fbf-409f-aa5f-a7ade42bf54a-installation-pull-secrets\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:11:38.096141 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.095826    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgst6\" (UniqueName: \"kubernetes.io/projected/aceee503-0fbf-409f-aa5f-a7ade42bf54a-kube-api-access-qgst6\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:11:38.096141 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.095842    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aceee503-0fbf-409f-aa5f-a7ade42bf54a-registry-certificates\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:11:38.354041 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.353948    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cd7d5f55-d8x87" event={"ID":"33896a64-9497-473a-bab5-2cb1293c1475","Type":"ContainerStarted","Data":"748040dd40a9dc3f491e5756e092c1a9c81463c4de6af9f83a13592b7bf69420"}
Jul 23 12:11:38.355066 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.355043    2570 generic.go:356] "Generic (PLEG): container finished" podID="aceee503-0fbf-409f-aa5f-a7ade42bf54a" containerID="1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf" exitCode=0
Jul 23 12:11:38.355147 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.355091    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679d56cf84-lfw28" event={"ID":"aceee503-0fbf-409f-aa5f-a7ade42bf54a","Type":"ContainerDied","Data":"1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf"}
Jul 23 12:11:38.355147 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.355102    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679d56cf84-lfw28"
Jul 23 12:11:38.355147 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.355131    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679d56cf84-lfw28" event={"ID":"aceee503-0fbf-409f-aa5f-a7ade42bf54a","Type":"ContainerDied","Data":"51dbe4695ce4f1e4ea4c8f1cb4b2a60812c236442616cfcf968a1f0ed921bca3"}
Jul 23 12:11:38.355249 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.355157    2570 scope.go:117] "RemoveContainer" containerID="1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf"
Jul 23 12:11:38.363572 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.363553    2570 scope.go:117] "RemoveContainer" containerID="1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf"
Jul 23 12:11:38.363847 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:11:38.363827    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf\": container with ID starting with 1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf not found: ID does not exist" containerID="1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf"
Jul 23 12:11:38.363899 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.363858    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf"} err="failed to get container status \"1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf\": rpc error: code = NotFound desc = could not find container \"1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf\": container with ID starting with 1e66e22b5c2f3e2296088595158270f9aa8497894794fc0bcfadc8497d8bb3bf not found: ID does not exist"
Jul 23 12:11:38.380271 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.380234    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-679d56cf84-lfw28"]
Jul 23 12:11:38.383786 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.383755    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-679d56cf84-lfw28"]
Jul 23 12:11:38.739115 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:38.739074    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aceee503-0fbf-409f-aa5f-a7ade42bf54a" path="/var/lib/kubelet/pods/aceee503-0fbf-409f-aa5f-a7ade42bf54a/volumes"
Jul 23 12:11:39.676213 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:39.676174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:39.774330 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:39.774292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:41.178795 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:41.178706    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:41.238349 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:41.238312    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:41.372528 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:41.372491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cd7d5f55-d8x87" event={"ID":"33896a64-9497-473a-bab5-2cb1293c1475","Type":"ContainerStarted","Data":"badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01"}
Jul 23 12:11:41.394838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:41.394760    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65cd7d5f55-d8x87" podStartSLOduration=1.572336053 podStartE2EDuration="4.394740126s" totalImagesPullingTime="2.822404073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:11:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:41.393907727 +0000 UTC m=+103.155027079" watchObservedRunningTime="2026-07-23 12:11:41.394740126 +0000 UTC m=+103.155859476"
Jul 23 12:11:42.356048 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.356018    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-95f4b9bcf-twrwl"
Jul 23 12:11:42.739254 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.739221    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7796858cd5-wb82d"]
Jul 23 12:11:42.740183 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.740158    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aceee503-0fbf-409f-aa5f-a7ade42bf54a" containerName="registry"
Jul 23 12:11:42.740328 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.740316    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aceee503-0fbf-409f-aa5f-a7ade42bf54a" containerName="registry"
Jul 23 12:11:42.740584 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.740570    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="aceee503-0fbf-409f-aa5f-a7ade42bf54a" containerName="registry"
Jul 23 12:11:42.782492 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.782446    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7796858cd5-wb82d"]
Jul 23 12:11:42.782654 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.782598    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.845645 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.845603    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-oauth-serving-cert\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.845645 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.845647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-config\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.845851 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.845707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-oauth-config\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.845851 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.845776    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-serving-cert\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.845851 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.845807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-service-ca\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.845851 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.845834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfc7r\" (UniqueName: \"kubernetes.io/projected/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-kube-api-access-vfc7r\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.845978 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.845857    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-trusted-ca-bundle\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.947051 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.947018    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-serving-cert\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.947258 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.947061    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-service-ca\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.947258 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.947082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfc7r\" (UniqueName: \"kubernetes.io/projected/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-kube-api-access-vfc7r\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.947258 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.947120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-trusted-ca-bundle\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.947258 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.947142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-oauth-serving-cert\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.947258 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.947164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-config\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.947258 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.947204    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-oauth-config\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.948007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.947971    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-oauth-serving-cert\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.948007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.947990    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-config\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.948171 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.948045    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-service-ca\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.948171 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.948118    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-trusted-ca-bundle\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.949646 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.949625    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-oauth-config\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.949736 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.949719    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-serving-cert\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:42.961624 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:42.961600    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfc7r\" (UniqueName: \"kubernetes.io/projected/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-kube-api-access-vfc7r\") pod \"console-7796858cd5-wb82d\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") " pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:43.093021 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:43.092925    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:43.296993 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:43.296944    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7796858cd5-wb82d"]
Jul 23 12:11:43.299033 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:11:43.299007    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f8bbe5_4a51_4f5e_be07_485e2dbdb1da.slice/crio-1491a1fa6f2f526a3a48f14f365ea993642cd0738342781ad84d1dcb966abe2c WatchSource:0}: Error finding container 1491a1fa6f2f526a3a48f14f365ea993642cd0738342781ad84d1dcb966abe2c: Status 404 returned error can't find the container with id 1491a1fa6f2f526a3a48f14f365ea993642cd0738342781ad84d1dcb966abe2c
Jul 23 12:11:43.383411 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:43.383370    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7796858cd5-wb82d" event={"ID":"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da","Type":"ContainerStarted","Data":"1491a1fa6f2f526a3a48f14f365ea993642cd0738342781ad84d1dcb966abe2c"}
Jul 23 12:11:44.388256 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:44.388220    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7796858cd5-wb82d" event={"ID":"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da","Type":"ContainerStarted","Data":"a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13"}
Jul 23 12:11:44.408529 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:44.408456    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7796858cd5-wb82d" podStartSLOduration=2.408439778 podStartE2EDuration="2.408439778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:11:44.408417785 +0000 UTC m=+106.169537157" watchObservedRunningTime="2026-07-23 12:11:44.408439778 +0000 UTC m=+106.169559128"
Jul 23 12:11:45.228260 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:45.228227    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dqxkg"
Jul 23 12:11:47.646316 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:47.646282    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:47.646850 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:47.646390    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:47.650953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:47.650932    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:48.154626 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:48.154593    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:48.256186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:48.256152    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:48.409577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:48.409506    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:11:48.628631 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:48.628596    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:48.727260 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:48.727201    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:49.883201 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:49.883159    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:50.703465 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:50.703428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:50.762900 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:50.762860    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:53.093568 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:53.093521    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:53.093975 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:53.093599    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:53.098316 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:53.098293    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:53.428667 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:53.428593    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:11:53.483831 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:53.483791    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cd7d5f55-d8x87"]
Jul 23 12:11:53.606396 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:53.606363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:53.669853 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:53.669816    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:53.742320 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:53.742285    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:54.701789 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:54.701753    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:58.144185 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:58.144142    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:58.244753 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:58.244723    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:58.300572 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:58.300541    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:58.847382 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:58.847301    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:11:58.913973 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:11:58.913942    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:00.744799 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:00.744760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:00.807282 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:00.807253    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:01.920159 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:01.920128    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:01.980479 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:01.980446    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:05.726337 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:05.726302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:05.830656 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:05.830618    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:18.513575 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.513514    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65cd7d5f55-d8x87" podUID="33896a64-9497-473a-bab5-2cb1293c1475" containerName="console" containerID="cri-o://badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01" gracePeriod=15
Jul 23 12:12:18.770353 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.770282    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:12:18.855999 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.855959    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-oauth-config\") pod \"33896a64-9497-473a-bab5-2cb1293c1475\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") "
Jul 23 12:12:18.855999 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856004    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-console-config\") pod \"33896a64-9497-473a-bab5-2cb1293c1475\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") "
Jul 23 12:12:18.856229 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856041    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z77vl\" (UniqueName: \"kubernetes.io/projected/33896a64-9497-473a-bab5-2cb1293c1475-kube-api-access-z77vl\") pod \"33896a64-9497-473a-bab5-2cb1293c1475\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") "
Jul 23 12:12:18.856229 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856066    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-service-ca\") pod \"33896a64-9497-473a-bab5-2cb1293c1475\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") "
Jul 23 12:12:18.856229 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856093    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-serving-cert\") pod \"33896a64-9497-473a-bab5-2cb1293c1475\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") "
Jul 23 12:12:18.856229 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856113    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-oauth-serving-cert\") pod \"33896a64-9497-473a-bab5-2cb1293c1475\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") "
Jul 23 12:12:18.856229 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856144    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-trusted-ca-bundle\") pod \"33896a64-9497-473a-bab5-2cb1293c1475\" (UID: \"33896a64-9497-473a-bab5-2cb1293c1475\") "
Jul 23 12:12:18.856639 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856611    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-service-ca" (OuterVolumeSpecName: "service-ca") pod "33896a64-9497-473a-bab5-2cb1293c1475" (UID: "33896a64-9497-473a-bab5-2cb1293c1475"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:12:18.856639 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856622    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-console-config" (OuterVolumeSpecName: "console-config") pod "33896a64-9497-473a-bab5-2cb1293c1475" (UID: "33896a64-9497-473a-bab5-2cb1293c1475"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:12:18.856795 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856707    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "33896a64-9497-473a-bab5-2cb1293c1475" (UID: "33896a64-9497-473a-bab5-2cb1293c1475"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:12:18.856795 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.856704    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "33896a64-9497-473a-bab5-2cb1293c1475" (UID: "33896a64-9497-473a-bab5-2cb1293c1475"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:12:18.858281 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.858253    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "33896a64-9497-473a-bab5-2cb1293c1475" (UID: "33896a64-9497-473a-bab5-2cb1293c1475"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:12:18.858392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.858355    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "33896a64-9497-473a-bab5-2cb1293c1475" (UID: "33896a64-9497-473a-bab5-2cb1293c1475"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:12:18.858392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.858362    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33896a64-9497-473a-bab5-2cb1293c1475-kube-api-access-z77vl" (OuterVolumeSpecName: "kube-api-access-z77vl") pod "33896a64-9497-473a-bab5-2cb1293c1475" (UID: "33896a64-9497-473a-bab5-2cb1293c1475"). InnerVolumeSpecName "kube-api-access-z77vl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:12:18.957022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.956977    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-oauth-serving-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:18.957022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.957014    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-trusted-ca-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:18.957022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.957024    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-oauth-config\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:18.957022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.957033    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-console-config\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:18.957287 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.957044    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z77vl\" (UniqueName: \"kubernetes.io/projected/33896a64-9497-473a-bab5-2cb1293c1475-kube-api-access-z77vl\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:18.957287 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.957055    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33896a64-9497-473a-bab5-2cb1293c1475-service-ca\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:18.957287 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:18.957063    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33896a64-9497-473a-bab5-2cb1293c1475-console-serving-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:19.522966 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:19.522929    2570 generic.go:356] "Generic (PLEG): container finished" podID="33896a64-9497-473a-bab5-2cb1293c1475" containerID="badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01" exitCode=0
Jul 23 12:12:19.523364 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:19.522977    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cd7d5f55-d8x87"
Jul 23 12:12:19.523364 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:19.523021    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cd7d5f55-d8x87" event={"ID":"33896a64-9497-473a-bab5-2cb1293c1475","Type":"ContainerDied","Data":"badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01"}
Jul 23 12:12:19.523364 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:19.523068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cd7d5f55-d8x87" event={"ID":"33896a64-9497-473a-bab5-2cb1293c1475","Type":"ContainerDied","Data":"748040dd40a9dc3f491e5756e092c1a9c81463c4de6af9f83a13592b7bf69420"}
Jul 23 12:12:19.523364 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:19.523088    2570 scope.go:117] "RemoveContainer" containerID="badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01"
Jul 23 12:12:19.531801 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:19.531782    2570 scope.go:117] "RemoveContainer" containerID="badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01"
Jul 23 12:12:19.532088 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:12:19.532069    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01\": container with ID starting with badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01 not found: ID does not exist" containerID="badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01"
Jul 23 12:12:19.532142 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:19.532098    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01"} err="failed to get container status \"badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01\": rpc error: code = NotFound desc = could not find container \"badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01\": container with ID starting with badc3857840fc2b5aece982b2b7f1a33bac44590c64972b29cfa6ed40c6aae01 not found: ID does not exist"
Jul 23 12:12:19.546181 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:19.546146    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cd7d5f55-d8x87"]
Jul 23 12:12:19.550499 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:19.550456    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65cd7d5f55-d8x87"]
Jul 23 12:12:20.710767 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:20.710721    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:20.737442 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:20.737405    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33896a64-9497-473a-bab5-2cb1293c1475" path="/var/lib/kubelet/pods/33896a64-9497-473a-bab5-2cb1293c1475/volumes"
Jul 23 12:12:20.776994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:20.776958    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:45.269838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:45.269802    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:45.327410 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:45.327367    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:49.604516 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:49.604462    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 12:12:49.604941 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:49.604801    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="alertmanager" containerID="cri-o://b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d" gracePeriod=120
Jul 23 12:12:49.604941 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:49.604871    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy-metric" containerID="cri-o://154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c" gracePeriod=120
Jul 23 12:12:49.605064 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:49.604915    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="prom-label-proxy" containerID="cri-o://106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a" gracePeriod=120
Jul 23 12:12:49.605064 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:49.604929    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy" containerID="cri-o://41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8" gracePeriod=120
Jul 23 12:12:49.605064 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:49.604960    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="config-reloader" containerID="cri-o://093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579" gracePeriod=120
Jul 23 12:12:49.605064 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:49.604922    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy-web" containerID="cri-o://0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf" gracePeriod=120
Jul 23 12:12:50.649669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.649636    2570 generic.go:356] "Generic (PLEG): container finished" podID="9961ed0c-58fa-4cba-b4b0-162487413071" containerID="106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a" exitCode=0
Jul 23 12:12:50.649669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.649661    2570 generic.go:356] "Generic (PLEG): container finished" podID="9961ed0c-58fa-4cba-b4b0-162487413071" containerID="41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8" exitCode=0
Jul 23 12:12:50.649669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.649668    2570 generic.go:356] "Generic (PLEG): container finished" podID="9961ed0c-58fa-4cba-b4b0-162487413071" containerID="093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579" exitCode=0
Jul 23 12:12:50.649669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.649673    2570 generic.go:356] "Generic (PLEG): container finished" podID="9961ed0c-58fa-4cba-b4b0-162487413071" containerID="b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d" exitCode=0
Jul 23 12:12:50.650132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.649708    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerDied","Data":"106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a"}
Jul 23 12:12:50.650132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.649772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerDied","Data":"41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8"}
Jul 23 12:12:50.650132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.649797    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerDied","Data":"093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579"}
Jul 23 12:12:50.650132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.649823    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerDied","Data":"b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d"}
Jul 23 12:12:50.856978 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.856949    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:50.915079 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.914983    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-tls-assets\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915079 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915037    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-trusted-ca-bundle\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915298 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915104    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-metrics-client-ca\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915298 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915126    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-config-out\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915298 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915150    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-main-db\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915453 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915355    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47j9b\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-kube-api-access-47j9b\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915453 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915396    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-config-volume\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915453 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915424    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915616 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915457    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915616 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915505    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-cluster-tls-config\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915616 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915539    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-web-config\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915616 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915564    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:12:50.915616 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915585    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-main-tls\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915616 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915592    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:12:50.915616 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915613    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-web\") pod \"9961ed0c-58fa-4cba-b4b0-162487413071\" (UID: \"9961ed0c-58fa-4cba-b4b0-162487413071\") "
Jul 23 12:12:50.915938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915844    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:50.915938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.915861    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9961ed0c-58fa-4cba-b4b0-162487413071-metrics-client-ca\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:50.916705 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.916675    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:12:50.919529 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.919463    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-config-out" (OuterVolumeSpecName: "config-out") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:12:50.919732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.919687    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:12:50.919852 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.919745    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:12:50.920073 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.920036    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:12:50.920850 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.920820    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:12:50.921071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.921048    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-config-volume" (OuterVolumeSpecName: "config-volume") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:12:50.921548 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.921448    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-kube-api-access-47j9b" (OuterVolumeSpecName: "kube-api-access-47j9b") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "kube-api-access-47j9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:12:50.922203 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.922179    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:12:50.923878 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.923846    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:12:50.930950 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:50.930915    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-web-config" (OuterVolumeSpecName: "web-config") pod "9961ed0c-58fa-4cba-b4b0-162487413071" (UID: "9961ed0c-58fa-4cba-b4b0-162487413071"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:12:51.016691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016645    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-config-out\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016682    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9961ed0c-58fa-4cba-b4b0-162487413071-alertmanager-main-db\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016692    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47j9b\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-kube-api-access-47j9b\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016701    2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-config-volume\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016712    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016722    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016731    2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-cluster-tls-config\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016740    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-web-config\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016749    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-main-tls\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016758    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9961ed0c-58fa-4cba-b4b0-162487413071-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.016943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.016766    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9961ed0c-58fa-4cba-b4b0-162487413071-tls-assets\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:12:51.656094 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.656057    2570 generic.go:356] "Generic (PLEG): container finished" podID="9961ed0c-58fa-4cba-b4b0-162487413071" containerID="154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c" exitCode=0
Jul 23 12:12:51.656094 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.656082    2570 generic.go:356] "Generic (PLEG): container finished" podID="9961ed0c-58fa-4cba-b4b0-162487413071" containerID="0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf" exitCode=0
Jul 23 12:12:51.656606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.656136    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerDied","Data":"154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c"}
Jul 23 12:12:51.656606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.656150    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.656606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.656207    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerDied","Data":"0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf"}
Jul 23 12:12:51.656606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.656237    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9961ed0c-58fa-4cba-b4b0-162487413071","Type":"ContainerDied","Data":"ed04ac73acbdc0f5a57e0ae49a9f0d463b2914ecfd12fa15760c5640f2925fcc"}
Jul 23 12:12:51.656606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.656254    2570 scope.go:117] "RemoveContainer" containerID="106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a"
Jul 23 12:12:51.666155 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.666133    2570 scope.go:117] "RemoveContainer" containerID="154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c"
Jul 23 12:12:51.673189 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.673171    2570 scope.go:117] "RemoveContainer" containerID="41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8"
Jul 23 12:12:51.679848 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.679830    2570 scope.go:117] "RemoveContainer" containerID="0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf"
Jul 23 12:12:51.688182 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.685080    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 12:12:51.690445 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.690372    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 12:12:51.700353 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.700328    2570 scope.go:117] "RemoveContainer" containerID="093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579"
Jul 23 12:12:51.707684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.707661    2570 scope.go:117] "RemoveContainer" containerID="b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d"
Jul 23 12:12:51.715180 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.715156    2570 scope.go:117] "RemoveContainer" containerID="7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397"
Jul 23 12:12:51.722735 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.722583    2570 scope.go:117] "RemoveContainer" containerID="106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a"
Jul 23 12:12:51.722954 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:12:51.722926    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a\": container with ID starting with 106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a not found: ID does not exist" containerID="106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a"
Jul 23 12:12:51.723066 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.722964    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a"} err="failed to get container status \"106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a\": rpc error: code = NotFound desc = could not find container \"106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a\": container with ID starting with 106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a not found: ID does not exist"
Jul 23 12:12:51.723066 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.722987    2570 scope.go:117] "RemoveContainer" containerID="154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c"
Jul 23 12:12:51.723183 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723066    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 12:12:51.723267 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:12:51.723249    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c\": container with ID starting with 154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c not found: ID does not exist" containerID="154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c"
Jul 23 12:12:51.723320 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723272    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c"} err="failed to get container status \"154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c\": rpc error: code = NotFound desc = could not find container \"154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c\": container with ID starting with 154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c not found: ID does not exist"
Jul 23 12:12:51.723320 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723287    2570 scope.go:117] "RemoveContainer" containerID="41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8"
Jul 23 12:12:51.723521 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723465    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="alertmanager"
Jul 23 12:12:51.723593 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723524    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="alertmanager"
Jul 23 12:12:51.723593 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723544    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy"
Jul 23 12:12:51.723593 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723552    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy"
Jul 23 12:12:51.723593 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723566    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33896a64-9497-473a-bab5-2cb1293c1475" containerName="console"
Jul 23 12:12:51.723593 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723575    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="33896a64-9497-473a-bab5-2cb1293c1475" containerName="console"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723599    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="config-reloader"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723607    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="config-reloader"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723618    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy-web"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723626    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy-web"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723641    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="init-config-reloader"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:12:51.723566    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8\": container with ID starting with 41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8 not found: ID does not exist" containerID="41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723665    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8"} err="failed to get container status \"41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8\": rpc error: code = NotFound desc = could not find container \"41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8\": container with ID starting with 41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8 not found: ID does not exist"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723680    2570 scope.go:117] "RemoveContainer" containerID="0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723649    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="init-config-reloader"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723735    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="prom-label-proxy"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723745    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="prom-label-proxy"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723755    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy-metric"
Jul 23 12:12:51.723797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723764    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy-metric"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723837    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="config-reloader"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723848    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723861    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy-metric"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723869    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="prom-label-proxy"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723879    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="33896a64-9497-473a-bab5-2cb1293c1475" containerName="console"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723889    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="alertmanager"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723897    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" containerName="kube-rbac-proxy-web"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:12:51.723903    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf\": container with ID starting with 0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf not found: ID does not exist" containerID="0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723928    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf"} err="failed to get container status \"0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf\": rpc error: code = NotFound desc = could not find container \"0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf\": container with ID starting with 0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf not found: ID does not exist"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.723943    2570 scope.go:117] "RemoveContainer" containerID="093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:12:51.724214    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579\": container with ID starting with 093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579 not found: ID does not exist" containerID="093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.724232    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579"} err="failed to get container status \"093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579\": rpc error: code = NotFound desc = could not find container \"093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579\": container with ID starting with 093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579 not found: ID does not exist"
Jul 23 12:12:51.724407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.724246    2570 scope.go:117] "RemoveContainer" containerID="b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d"
Jul 23 12:12:51.725019 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:12:51.724509    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d\": container with ID starting with b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d not found: ID does not exist" containerID="b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d"
Jul 23 12:12:51.725019 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.724531    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d"} err="failed to get container status \"b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d\": rpc error: code = NotFound desc = could not find container \"b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d\": container with ID starting with b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d not found: ID does not exist"
Jul 23 12:12:51.725019 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.724552    2570 scope.go:117] "RemoveContainer" containerID="7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397"
Jul 23 12:12:51.725019 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:12:51.724822    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397\": container with ID starting with 7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397 not found: ID does not exist" containerID="7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397"
Jul 23 12:12:51.725019 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.724842    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397"} err="failed to get container status \"7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397\": rpc error: code = NotFound desc = could not find container \"7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397\": container with ID starting with 7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397 not found: ID does not exist"
Jul 23 12:12:51.725019 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.724857    2570 scope.go:117] "RemoveContainer" containerID="106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a"
Jul 23 12:12:51.725305 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.725083    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a"} err="failed to get container status \"106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a\": rpc error: code = NotFound desc = could not find container \"106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a\": container with ID starting with 106ac0dd054b0fe648516c9ae8b11cae6341d555ef8798073a56483d4a35f71a not found: ID does not exist"
Jul 23 12:12:51.725305 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.725097    2570 scope.go:117] "RemoveContainer" containerID="154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c"
Jul 23 12:12:51.725399 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.725330    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c"} err="failed to get container status \"154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c\": rpc error: code = NotFound desc = could not find container \"154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c\": container with ID starting with 154e9667ead4f6f64751eb75aa345f7b77269c7e90db12bc25c15218a585ff9c not found: ID does not exist"
Jul 23 12:12:51.725399 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.725342    2570 scope.go:117] "RemoveContainer" containerID="41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8"
Jul 23 12:12:51.725581 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.725563    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8"} err="failed to get container status \"41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8\": rpc error: code = NotFound desc = could not find container \"41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8\": container with ID starting with 41a1c4b9386d42f55756143383703d48e8469b2b116b145e7e62cd210da055f8 not found: ID does not exist"
Jul 23 12:12:51.725621 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.725581    2570 scope.go:117] "RemoveContainer" containerID="0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf"
Jul 23 12:12:51.725822 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.725803    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf"} err="failed to get container status \"0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf\": rpc error: code = NotFound desc = could not find container \"0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf\": container with ID starting with 0ab52485a98b03c575b38fe4dd6bdeea774a96ac271c7190639a9e2a2df46adf not found: ID does not exist"
Jul 23 12:12:51.725822 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.725822    2570 scope.go:117] "RemoveContainer" containerID="093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579"
Jul 23 12:12:51.726123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.726102    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579"} err="failed to get container status \"093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579\": rpc error: code = NotFound desc = could not find container \"093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579\": container with ID starting with 093c73774dc46dfe6e8ec093dfef86b86c8cd90485705536965ad93d53716579 not found: ID does not exist"
Jul 23 12:12:51.726123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.726122    2570 scope.go:117] "RemoveContainer" containerID="b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d"
Jul 23 12:12:51.726370 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.726349    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d"} err="failed to get container status \"b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d\": rpc error: code = NotFound desc = could not find container \"b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d\": container with ID starting with b261b8f9eeee1aa0c2d22c3c2bf5379fa330b02128012e3b9860759c5193419d not found: ID does not exist"
Jul 23 12:12:51.726423 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.726371    2570 scope.go:117] "RemoveContainer" containerID="7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397"
Jul 23 12:12:51.726640 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.726617    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397"} err="failed to get container status \"7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397\": rpc error: code = NotFound desc = could not find container \"7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397\": container with ID starting with 7cf7297d3c20630db0d0740e50fb2fb9e219925a3c7bdd2e38a06493f7bf2397 not found: ID does not exist"
Jul 23 12:12:51.729348 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.729332    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.732122 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.732102    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 12:12:51.732538 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.732369    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 12:12:51.732538 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.732404    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 12:12:51.732538 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.732404    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 12:12:51.732538 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.732457    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 12:12:51.732538 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.732536    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 12:12:51.732843 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.732616    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 12:12:51.732843 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.732758    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v945x\""
Jul 23 12:12:51.733269 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.733252    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 12:12:51.739067 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.739046    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 12:12:51.741784 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.741763    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 12:12:51.823376 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823334    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823376 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-web-config\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823602 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823602 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-config-out\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823602 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823546    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823602 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823602 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-config-volume\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823754 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823605    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823754 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823628    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823754 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823754 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr55d\" (UniqueName: \"kubernetes.io/projected/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-kube-api-access-fr55d\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823754 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823697    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.823754 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.823716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.924796 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924696    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.924796 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924754    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-config-out\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.924796 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924786    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-config-volume\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924855    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924877    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924932    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr55d\" (UniqueName: \"kubernetes.io/projected/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-kube-api-access-fr55d\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924962    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.924989    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.925024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925087 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.925064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-web-config\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925602 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.925525    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.925858 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.925832    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.926080 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.926051    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.928277 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.927939    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-config-out\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.928277 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.927972    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.928277 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.928069    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.928277 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.928230    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.928277 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.928258    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-config-volume\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.928518 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.928312    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-web-config\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.928653 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.928629    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.929702 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.929680    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.930136 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.930116    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:51.936377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:51.936357    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr55d\" (UniqueName: \"kubernetes.io/projected/d69aa25d-b39f-45a7-a0fd-0e24c883acc4-kube-api-access-fr55d\") pod \"alertmanager-main-0\" (UID: \"d69aa25d-b39f-45a7-a0fd-0e24c883acc4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:52.038654 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:52.038611    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 12:12:52.188163 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:52.187779    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 12:12:52.189901 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:12:52.189874    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69aa25d_b39f_45a7_a0fd_0e24c883acc4.slice/crio-01a9ffd44f2dd725aa645ba9487417867583d142f6c1af3703d7af962d13f904 WatchSource:0}: Error finding container 01a9ffd44f2dd725aa645ba9487417867583d142f6c1af3703d7af962d13f904: Status 404 returned error can't find the container with id 01a9ffd44f2dd725aa645ba9487417867583d142f6c1af3703d7af962d13f904
Jul 23 12:12:52.661899 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:52.661861    2570 generic.go:356] "Generic (PLEG): container finished" podID="d69aa25d-b39f-45a7-a0fd-0e24c883acc4" containerID="e1e5e68dc4f9e23ad2b777c203d2ea476141b1346402e9a69de5f6c53b5b81c8" exitCode=0
Jul 23 12:12:52.662399 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:52.661915    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d69aa25d-b39f-45a7-a0fd-0e24c883acc4","Type":"ContainerDied","Data":"e1e5e68dc4f9e23ad2b777c203d2ea476141b1346402e9a69de5f6c53b5b81c8"}
Jul 23 12:12:52.662399 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:52.661967    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d69aa25d-b39f-45a7-a0fd-0e24c883acc4","Type":"ContainerStarted","Data":"01a9ffd44f2dd725aa645ba9487417867583d142f6c1af3703d7af962d13f904"}
Jul 23 12:12:52.737347 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:52.737314    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9961ed0c-58fa-4cba-b4b0-162487413071" path="/var/lib/kubelet/pods/9961ed0c-58fa-4cba-b4b0-162487413071/volumes"
Jul 23 12:12:53.672332 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:53.672291    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d69aa25d-b39f-45a7-a0fd-0e24c883acc4","Type":"ContainerStarted","Data":"c416c37be395ebf2e13cf7b7f406645d5701c658d115106d704d2e80b4ec0daf"}
Jul 23 12:12:53.672838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:53.672417    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d69aa25d-b39f-45a7-a0fd-0e24c883acc4","Type":"ContainerStarted","Data":"f5f17be9f3aa463141df5060a8300e840f63475ebfef16468f9bb6f78b83a759"}
Jul 23 12:12:53.672838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:53.672462    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d69aa25d-b39f-45a7-a0fd-0e24c883acc4","Type":"ContainerStarted","Data":"aaa7169bae1a3e3cece767e147b0473c9f70c72dceb09b6d6a97adfa8b693445"}
Jul 23 12:12:53.672838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:53.672534    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d69aa25d-b39f-45a7-a0fd-0e24c883acc4","Type":"ContainerStarted","Data":"9239d16f0080a3d06775b7ac874603dc55a8b0128553c652b5c276ff961eb6cc"}
Jul 23 12:12:53.672838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:53.672572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d69aa25d-b39f-45a7-a0fd-0e24c883acc4","Type":"ContainerStarted","Data":"828effc0ebe9960a580fd7bc48719f76590b421a3418b07109c46d0b357e6e5e"}
Jul 23 12:12:53.672838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:53.672618    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d69aa25d-b39f-45a7-a0fd-0e24c883acc4","Type":"ContainerStarted","Data":"486aa358f73c3aa3dcd6cf6730cc09059545941df522ae934f538d4dd25c5ef8"}
Jul 23 12:12:53.705065 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:53.704987    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.689016937 podStartE2EDuration="2.704965134s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.948197ms" isStatefulPod=false podCreationTimestamp="2026-07-23 12:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:12:53.702999654 +0000 UTC m=+175.464119005" watchObservedRunningTime="2026-07-23 12:12:53.704965134 +0000 UTC m=+175.466084487"
Jul 23 12:12:57.253609 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:57.253573    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:12:57.354767 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:12:57.354730    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:05.713019 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:05.712977    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:05.816737 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:05.816693    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:05.916546 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:05.916508    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:13.583207 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.583162    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c86c9786c-mzn7z"]
Jul 23 12:13:13.588145 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.588118    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.607971 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.607867    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c86c9786c-mzn7z"]
Jul 23 12:13:13.655334 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.655299    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:13.723686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.723638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-service-ca\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.723686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.723689    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-trusted-ca-bundle\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.723885 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.723732    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-oauth-config\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.723885 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.723770    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk8pk\" (UniqueName: \"kubernetes.io/projected/ce2a3635-bc8f-476e-9840-fb343a6e94f5-kube-api-access-wk8pk\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.723885 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.723844    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-config\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.723985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.723909    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-serving-cert\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.723985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.723942    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-oauth-serving-cert\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.740510 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.740456    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:13.817553 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.817513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:13.824607 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.824578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-service-ca\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.824691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.824619    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-trusted-ca-bundle\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.824691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.824649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-oauth-config\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.824691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.824677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk8pk\" (UniqueName: \"kubernetes.io/projected/ce2a3635-bc8f-476e-9840-fb343a6e94f5-kube-api-access-wk8pk\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.824838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.824714    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-config\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.825524 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.825062    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-serving-cert\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.825524 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.825163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-oauth-serving-cert\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.825524 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.825393    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-service-ca\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.825524 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.825494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-config\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.825796 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.825713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-trusted-ca-bundle\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.825855 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.825833    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-oauth-serving-cert\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.827304 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.827284    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-oauth-config\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.827482 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.827451    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-serving-cert\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.851912 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.851846    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk8pk\" (UniqueName: \"kubernetes.io/projected/ce2a3635-bc8f-476e-9840-fb343a6e94f5-kube-api-access-wk8pk\") pod \"console-7c86c9786c-mzn7z\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") " pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:13.897775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:13.897737    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:14.038880 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:14.038849    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c86c9786c-mzn7z"]
Jul 23 12:13:14.042671 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:13:14.042645    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce2a3635_bc8f_476e_9840_fb343a6e94f5.slice/crio-69913b40a4d05b873fe439341b106e28ee8e4ee47152ecf84b79d0ef85340110 WatchSource:0}: Error finding container 69913b40a4d05b873fe439341b106e28ee8e4ee47152ecf84b79d0ef85340110: Status 404 returned error can't find the container with id 69913b40a4d05b873fe439341b106e28ee8e4ee47152ecf84b79d0ef85340110
Jul 23 12:13:14.384837 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:14.384747    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:14.442460 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:14.442428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:14.755449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:14.755413    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c86c9786c-mzn7z" event={"ID":"ce2a3635-bc8f-476e-9840-fb343a6e94f5","Type":"ContainerStarted","Data":"dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1"}
Jul 23 12:13:14.755860 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:14.755482    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c86c9786c-mzn7z" event={"ID":"ce2a3635-bc8f-476e-9840-fb343a6e94f5","Type":"ContainerStarted","Data":"69913b40a4d05b873fe439341b106e28ee8e4ee47152ecf84b79d0ef85340110"}
Jul 23 12:13:14.777456 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:14.777404    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c86c9786c-mzn7z" podStartSLOduration=1.777387406 podStartE2EDuration="1.777387406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:13:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:13:14.77639721 +0000 UTC m=+196.537516561" watchObservedRunningTime="2026-07-23 12:13:14.777387406 +0000 UTC m=+196.538506757"
Jul 23 12:13:23.898086 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:23.898042    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:23.898586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:23.898108    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:23.902708 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:23.902687    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:24.797422 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:24.797390    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:13:24.849528 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:24.849464    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7796858cd5-wb82d"]
Jul 23 12:13:24.970800 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:24.970751    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:25.071227 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:25.071137    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:25.132735 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:25.132703    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:49.871844 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:49.871793    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7796858cd5-wb82d" podUID="b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" containerName="console" containerID="cri-o://a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13" gracePeriod=15
Jul 23 12:13:50.118548 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.118522    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:13:50.228810 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.228783    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-oauth-config\") pod \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") "
Jul 23 12:13:50.228993 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.228833    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-trusted-ca-bundle\") pod \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") "
Jul 23 12:13:50.228993 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.228850    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-service-ca\") pod \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") "
Jul 23 12:13:50.228993 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.228894    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-serving-cert\") pod \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") "
Jul 23 12:13:50.229161 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229014    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-config\") pod \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") "
Jul 23 12:13:50.229161 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229088    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfc7r\" (UniqueName: \"kubernetes.io/projected/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-kube-api-access-vfc7r\") pod \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") "
Jul 23 12:13:50.229161 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229132    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-oauth-serving-cert\") pod \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\" (UID: \"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da\") "
Jul 23 12:13:50.229384 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229342    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-service-ca" (OuterVolumeSpecName: "service-ca") pod "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" (UID: "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:13:50.229574 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229387    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" (UID: "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:13:50.229574 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229394    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-config" (OuterVolumeSpecName: "console-config") pod "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" (UID: "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:13:50.229705 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229624    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" (UID: "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:13:50.229705 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229655    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-config\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:13:50.229705 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229675    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-trusted-ca-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:13:50.229705 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.229689    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-service-ca\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:13:50.231079 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.231052    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" (UID: "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:13:50.231164 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.231095    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" (UID: "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:13:50.231164 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.231148    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-kube-api-access-vfc7r" (OuterVolumeSpecName: "kube-api-access-vfc7r") pod "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" (UID: "b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da"). InnerVolumeSpecName "kube-api-access-vfc7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:13:50.330799 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.330746    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-oauth-config\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:13:50.330799 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.330793    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-console-serving-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:13:50.330799 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.330803    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfc7r\" (UniqueName: \"kubernetes.io/projected/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-kube-api-access-vfc7r\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:13:50.330799 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.330813    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da-oauth-serving-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:13:50.892261 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.892227    2570 generic.go:356] "Generic (PLEG): container finished" podID="b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" containerID="a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13" exitCode=0
Jul 23 12:13:50.892700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.892275    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7796858cd5-wb82d"
Jul 23 12:13:50.892700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.892296    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7796858cd5-wb82d" event={"ID":"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da","Type":"ContainerDied","Data":"a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13"}
Jul 23 12:13:50.892700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.892339    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7796858cd5-wb82d" event={"ID":"b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da","Type":"ContainerDied","Data":"1491a1fa6f2f526a3a48f14f365ea993642cd0738342781ad84d1dcb966abe2c"}
Jul 23 12:13:50.892700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.892360    2570 scope.go:117] "RemoveContainer" containerID="a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13"
Jul 23 12:13:50.900289 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.900264    2570 scope.go:117] "RemoveContainer" containerID="a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13"
Jul 23 12:13:50.900560 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:13:50.900539    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13\": container with ID starting with a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13 not found: ID does not exist" containerID="a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13"
Jul 23 12:13:50.900637 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.900573    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13"} err="failed to get container status \"a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13\": rpc error: code = NotFound desc = could not find container \"a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13\": container with ID starting with a6ccd713389ffd98c74de4971ffeb82673e75a3c9ce029f0fc7db7aff4133e13 not found: ID does not exist"
Jul 23 12:13:50.917930 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.917899    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7796858cd5-wb82d"]
Jul 23 12:13:50.924935 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:50.924900    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7796858cd5-wb82d"]
Jul 23 12:13:52.426213 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:52.426179    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:52.524214 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:52.524180    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:13:52.737341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:52.737307    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" path="/var/lib/kubelet/pods/b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da/volumes"
Jul 23 12:13:53.016289 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.016207    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"]
Jul 23 12:13:53.016540 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.016527    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" containerName="console"
Jul 23 12:13:53.016588 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.016541    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" containerName="console"
Jul 23 12:13:53.016622 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.016591    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f8bbe5-4a51-4f5e-be07-485e2dbdb1da" containerName="console"
Jul 23 12:13:53.021042 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.021021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.023818 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.023800    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 12:13:53.024656 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.024634    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 12:13:53.024780 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.024670    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-55mqz\""
Jul 23 12:13:53.030957 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.030931    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"]
Jul 23 12:13:53.151200 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.151154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.151392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.151238    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpzh4\" (UniqueName: \"kubernetes.io/projected/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-kube-api-access-hpzh4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.151392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.151266    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.252395 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.252351    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpzh4\" (UniqueName: \"kubernetes.io/projected/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-kube-api-access-hpzh4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.252623 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.252408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.252623 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.252449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.252911 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.252887    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.252982 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.252896    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.263149 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.263115    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpzh4\" (UniqueName: \"kubernetes.io/projected/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-kube-api-access-hpzh4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.329455 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.329366    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:13:53.459556 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.459533    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"]
Jul 23 12:13:53.462004 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:13:53.461977    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10dc01e9_bed3_4940_bfb1_fc203f0bf29c.slice/crio-70e8d60127f2a11a0bd39dfb38ace0117de45c6ba0cc7a5ebed93e6b87bbd606 WatchSource:0}: Error finding container 70e8d60127f2a11a0bd39dfb38ace0117de45c6ba0cc7a5ebed93e6b87bbd606: Status 404 returned error can't find the container with id 70e8d60127f2a11a0bd39dfb38ace0117de45c6ba0cc7a5ebed93e6b87bbd606
Jul 23 12:13:53.905899 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:53.905867    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5" event={"ID":"10dc01e9-bed3-4940-bfb1-fc203f0bf29c","Type":"ContainerStarted","Data":"70e8d60127f2a11a0bd39dfb38ace0117de45c6ba0cc7a5ebed93e6b87bbd606"}
Jul 23 12:13:59.934071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:59.934038    2570 generic.go:356] "Generic (PLEG): container finished" podID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerID="10226c9aa943bbb43e659b219fbc6d958b05a84b77048afb083599424914613e" exitCode=0
Jul 23 12:13:59.934071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:13:59.934075    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5" event={"ID":"10dc01e9-bed3-4940-bfb1-fc203f0bf29c","Type":"ContainerDied","Data":"10226c9aa943bbb43e659b219fbc6d958b05a84b77048afb083599424914613e"}
Jul 23 12:14:01.945392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:01.945357    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5" event={"ID":"10dc01e9-bed3-4940-bfb1-fc203f0bf29c","Type":"ContainerStarted","Data":"7aa161b2a04f7ca10d09cf710e35e991d8fbd1f4622cd6e3e0f760449d16c928"}
Jul 23 12:14:02.952795 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:02.952758    2570 generic.go:356] "Generic (PLEG): container finished" podID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerID="7aa161b2a04f7ca10d09cf710e35e991d8fbd1f4622cd6e3e0f760449d16c928" exitCode=0
Jul 23 12:14:02.953203 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:02.952838    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5" event={"ID":"10dc01e9-bed3-4940-bfb1-fc203f0bf29c","Type":"ContainerDied","Data":"7aa161b2a04f7ca10d09cf710e35e991d8fbd1f4622cd6e3e0f760449d16c928"}
Jul 23 12:14:06.890392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:06.890357    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:08.978073 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:08.978040    2570 generic.go:356] "Generic (PLEG): container finished" podID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerID="6fa83a39942ae06aa950ee45b21d1bf330e81b1dc3fe8791665afb9a71d99cb2" exitCode=0
Jul 23 12:14:08.978439 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:08.978099    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5" event={"ID":"10dc01e9-bed3-4940-bfb1-fc203f0bf29c","Type":"ContainerDied","Data":"6fa83a39942ae06aa950ee45b21d1bf330e81b1dc3fe8791665afb9a71d99cb2"}
Jul 23 12:14:10.103505 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.103479    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:14:10.204178 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.204145    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-util\") pod \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") "
Jul 23 12:14:10.204353 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.204225    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-bundle\") pod \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") "
Jul 23 12:14:10.204353 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.204265    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpzh4\" (UniqueName: \"kubernetes.io/projected/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-kube-api-access-hpzh4\") pod \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\" (UID: \"10dc01e9-bed3-4940-bfb1-fc203f0bf29c\") "
Jul 23 12:14:10.204890 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.204861    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-bundle" (OuterVolumeSpecName: "bundle") pod "10dc01e9-bed3-4940-bfb1-fc203f0bf29c" (UID: "10dc01e9-bed3-4940-bfb1-fc203f0bf29c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:14:10.206489 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.206447    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-kube-api-access-hpzh4" (OuterVolumeSpecName: "kube-api-access-hpzh4") pod "10dc01e9-bed3-4940-bfb1-fc203f0bf29c" (UID: "10dc01e9-bed3-4940-bfb1-fc203f0bf29c"). InnerVolumeSpecName "kube-api-access-hpzh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:14:10.208526 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.208509    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-util" (OuterVolumeSpecName: "util") pod "10dc01e9-bed3-4940-bfb1-fc203f0bf29c" (UID: "10dc01e9-bed3-4940-bfb1-fc203f0bf29c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:14:10.305630 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.305538    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-util\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:14:10.305630 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.305568    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:14:10.305630 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.305579    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpzh4\" (UniqueName: \"kubernetes.io/projected/10dc01e9-bed3-4940-bfb1-fc203f0bf29c-kube-api-access-hpzh4\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:14:10.986483 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.986434    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5" event={"ID":"10dc01e9-bed3-4940-bfb1-fc203f0bf29c","Type":"ContainerDied","Data":"70e8d60127f2a11a0bd39dfb38ace0117de45c6ba0cc7a5ebed93e6b87bbd606"}
Jul 23 12:14:10.986642 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.986500    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqcr5"
Jul 23 12:14:10.986642 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:10.986506    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70e8d60127f2a11a0bd39dfb38ace0117de45c6ba0cc7a5ebed93e6b87bbd606"
Jul 23 12:14:14.109176 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:14.109121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:15.074318 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.074271    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:15.961981 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.961946    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"]
Jul 23 12:14:15.962359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.962231    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerName="util"
Jul 23 12:14:15.962359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.962241    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerName="util"
Jul 23 12:14:15.962359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.962257    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerName="pull"
Jul 23 12:14:15.962359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.962262    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerName="pull"
Jul 23 12:14:15.962359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.962275    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerName="extract"
Jul 23 12:14:15.962359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.962281    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerName="extract"
Jul 23 12:14:15.962359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.962327    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="10dc01e9-bed3-4940-bfb1-fc203f0bf29c" containerName="extract"
Jul 23 12:14:15.967112 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.967092    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"
Jul 23 12:14:15.970125 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.970104    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rbm9j\""
Jul 23 12:14:15.970125 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.970111    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 23 12:14:15.970125 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.970122    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 23 12:14:15.982623 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:15.982593    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"]
Jul 23 12:14:16.058386 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:16.058344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0da675db-6e1c-4185-8a8e-b7c782de9dd7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmfj\" (UID: \"0da675db-6e1c-4185-8a8e-b7c782de9dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"
Jul 23 12:14:16.058386 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:16.058385    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb8vg\" (UniqueName: \"kubernetes.io/projected/0da675db-6e1c-4185-8a8e-b7c782de9dd7-kube-api-access-jb8vg\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmfj\" (UID: \"0da675db-6e1c-4185-8a8e-b7c782de9dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"
Jul 23 12:14:16.159330 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:16.159297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0da675db-6e1c-4185-8a8e-b7c782de9dd7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmfj\" (UID: \"0da675db-6e1c-4185-8a8e-b7c782de9dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"
Jul 23 12:14:16.159434 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:16.159333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb8vg\" (UniqueName: \"kubernetes.io/projected/0da675db-6e1c-4185-8a8e-b7c782de9dd7-kube-api-access-jb8vg\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmfj\" (UID: \"0da675db-6e1c-4185-8a8e-b7c782de9dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"
Jul 23 12:14:16.159706 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:16.159688    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0da675db-6e1c-4185-8a8e-b7c782de9dd7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmfj\" (UID: \"0da675db-6e1c-4185-8a8e-b7c782de9dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"
Jul 23 12:14:16.171079 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:16.171039    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb8vg\" (UniqueName: \"kubernetes.io/projected/0da675db-6e1c-4185-8a8e-b7c782de9dd7-kube-api-access-jb8vg\") pod \"cert-manager-operator-controller-manager-55c444bf86-qmmfj\" (UID: \"0da675db-6e1c-4185-8a8e-b7c782de9dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"
Jul 23 12:14:16.276977 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:16.276941    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"
Jul 23 12:14:16.414613 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:16.414589    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj"]
Jul 23 12:14:16.416529 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:14:16.416502    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da675db_6e1c_4185_8a8e_b7c782de9dd7.slice/crio-7353754e33e3807c458d9c49a00e436b144464aa12d7aece65c7e3b29829c59b WatchSource:0}: Error finding container 7353754e33e3807c458d9c49a00e436b144464aa12d7aece65c7e3b29829c59b: Status 404 returned error can't find the container with id 7353754e33e3807c458d9c49a00e436b144464aa12d7aece65c7e3b29829c59b
Jul 23 12:14:17.010870 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:17.010834    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj" event={"ID":"0da675db-6e1c-4185-8a8e-b7c782de9dd7","Type":"ContainerStarted","Data":"7353754e33e3807c458d9c49a00e436b144464aa12d7aece65c7e3b29829c59b"}
Jul 23 12:14:17.867371 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:17.867331    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:17.969915 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:17.969868    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:19.021912 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.021875    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj" event={"ID":"0da675db-6e1c-4185-8a8e-b7c782de9dd7","Type":"ContainerStarted","Data":"b71307c5097b80fce225010eabe0b65ad63469c217fe4cde614fc3c437660339"}
Jul 23 12:14:19.046423 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.046369    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qmmfj" podStartSLOduration=2.326396861 podStartE2EDuration="4.046353272s" totalImagesPullingTime="1.719956411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:14:19.043966533 +0000 UTC m=+260.805085883" watchObservedRunningTime="2026-07-23 12:14:19.046353272 +0000 UTC m=+260.807472622"
Jul 23 12:14:19.261642 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.261601    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:19.355456 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.355357    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:19.411358 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.411325    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-njkdt"]
Jul 23 12:14:19.414633 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.414616    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:19.418034 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.418012    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 12:14:19.418169 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.418147    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 12:14:19.432708 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.432678    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-njkdt"]
Jul 23 12:14:19.478487 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.478449    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:19.577562 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.577527    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:19.589609 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.589579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lst45\" (UniqueName: \"kubernetes.io/projected/df1f1592-0f2d-46b0-b1ff-406b3c0bc07d-kube-api-access-lst45\") pod \"cert-manager-webhook-6486ffd997-njkdt\" (UID: \"df1f1592-0f2d-46b0-b1ff-406b3c0bc07d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:19.589750 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.589626    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df1f1592-0f2d-46b0-b1ff-406b3c0bc07d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-njkdt\" (UID: \"df1f1592-0f2d-46b0-b1ff-406b3c0bc07d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:19.691064 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.690985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lst45\" (UniqueName: \"kubernetes.io/projected/df1f1592-0f2d-46b0-b1ff-406b3c0bc07d-kube-api-access-lst45\") pod \"cert-manager-webhook-6486ffd997-njkdt\" (UID: \"df1f1592-0f2d-46b0-b1ff-406b3c0bc07d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:19.691064 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.691040    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df1f1592-0f2d-46b0-b1ff-406b3c0bc07d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-njkdt\" (UID: \"df1f1592-0f2d-46b0-b1ff-406b3c0bc07d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:19.707339 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.707314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lst45\" (UniqueName: \"kubernetes.io/projected/df1f1592-0f2d-46b0-b1ff-406b3c0bc07d-kube-api-access-lst45\") pod \"cert-manager-webhook-6486ffd997-njkdt\" (UID: \"df1f1592-0f2d-46b0-b1ff-406b3c0bc07d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:19.710307 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.710283    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df1f1592-0f2d-46b0-b1ff-406b3c0bc07d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-njkdt\" (UID: \"df1f1592-0f2d-46b0-b1ff-406b3c0bc07d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:19.740639 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.740596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:19.890229 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:19.890192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-njkdt"]
Jul 23 12:14:19.893222 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:14:19.893197    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf1f1592_0f2d_46b0_b1ff_406b3c0bc07d.slice/crio-933c95a5d0d0a4e18fee56c9e44f0939550d845a28d69a90628903795cae3060 WatchSource:0}: Error finding container 933c95a5d0d0a4e18fee56c9e44f0939550d845a28d69a90628903795cae3060: Status 404 returned error can't find the container with id 933c95a5d0d0a4e18fee56c9e44f0939550d845a28d69a90628903795cae3060
Jul 23 12:14:20.026899 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.026859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt" event={"ID":"df1f1592-0f2d-46b0-b1ff-406b3c0bc07d","Type":"ContainerStarted","Data":"933c95a5d0d0a4e18fee56c9e44f0939550d845a28d69a90628903795cae3060"}
Jul 23 12:14:20.268145 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.268101    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"]
Jul 23 12:14:20.271456 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.271438    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.277961 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.277894    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 12:14:20.278730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.278712    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 12:14:20.278900 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.278876    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-55mqz\""
Jul 23 12:14:20.294780 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.294756    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"]
Jul 23 12:14:20.397681 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.397650    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzr24\" (UniqueName: \"kubernetes.io/projected/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-kube-api-access-tzr24\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.397859 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.397723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.397927 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.397900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.499041 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.498999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.499215 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.499058    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzr24\" (UniqueName: \"kubernetes.io/projected/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-kube-api-access-tzr24\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.499215 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.499126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.499526 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.499496    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.499651 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.499555    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.509054 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.509030    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzr24\" (UniqueName: \"kubernetes.io/projected/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-kube-api-access-tzr24\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.581293 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.581197    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:20.738664 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:20.738638    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"]
Jul 23 12:14:20.739316 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:14:20.739283    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cf7e6e_d0e8_42ca_a84f_7640ead40e95.slice/crio-435019ba94ba9af1e0307645e942250b24769e0fb4f55a8519f55b6339064b47 WatchSource:0}: Error finding container 435019ba94ba9af1e0307645e942250b24769e0fb4f55a8519f55b6339064b47: Status 404 returned error can't find the container with id 435019ba94ba9af1e0307645e942250b24769e0fb4f55a8519f55b6339064b47
Jul 23 12:14:21.033128 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:21.033089    2570 generic.go:356] "Generic (PLEG): container finished" podID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerID="47d765471afa738fdb6f3599fa67c4962388b76459d5d9aa6b6c9a337b4d47f8" exitCode=0
Jul 23 12:14:21.033596 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:21.033175    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5" event={"ID":"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95","Type":"ContainerDied","Data":"47d765471afa738fdb6f3599fa67c4962388b76459d5d9aa6b6c9a337b4d47f8"}
Jul 23 12:14:21.033596 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:21.033225    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5" event={"ID":"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95","Type":"ContainerStarted","Data":"435019ba94ba9af1e0307645e942250b24769e0fb4f55a8519f55b6339064b47"}
Jul 23 12:14:21.689397 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:21.689343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:22.081186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:22.081145    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:23.044159 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:23.044125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt" event={"ID":"df1f1592-0f2d-46b0-b1ff-406b3c0bc07d","Type":"ContainerStarted","Data":"cf1af6b117aa099530607f0b7ad692d8710613a1a6b8f732a436089e871f57a9"}
Jul 23 12:14:23.044444 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:23.044229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:23.065111 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:23.065050    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt" podStartSLOduration=1.6109070189999999 podStartE2EDuration="4.065029974s" totalImagesPullingTime="2.454122955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:14:23.063681173 +0000 UTC m=+264.824800819" watchObservedRunningTime="2026-07-23 12:14:23.065029974 +0000 UTC m=+264.826149327"
Jul 23 12:14:24.050465 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:24.050382    2570 generic.go:356] "Generic (PLEG): container finished" podID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerID="2b257fdf9a8b85d1deb25b1b4545b2198444d66a54fda8c647f7edaae9dd515d" exitCode=0
Jul 23 12:14:24.050848 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:24.050479    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5" event={"ID":"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95","Type":"ContainerDied","Data":"2b257fdf9a8b85d1deb25b1b4545b2198444d66a54fda8c647f7edaae9dd515d"}
Jul 23 12:14:24.408345 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:24.408258    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:24.510745 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:24.510709    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:25.056129 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:25.056098    2570 generic.go:356] "Generic (PLEG): container finished" podID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerID="2494ae2d144a46505be9b795440cd59de43ab0aeb1477b437dc90ea7124a7020" exitCode=0
Jul 23 12:14:25.056525 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:25.056189    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5" event={"ID":"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95","Type":"ContainerDied","Data":"2494ae2d144a46505be9b795440cd59de43ab0aeb1477b437dc90ea7124a7020"}
Jul 23 12:14:26.184822 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.184798    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:26.244920 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.244887    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzr24\" (UniqueName: \"kubernetes.io/projected/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-kube-api-access-tzr24\") pod \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") "
Jul 23 12:14:26.245098 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.244951    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-util\") pod \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") "
Jul 23 12:14:26.245098 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.244977    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-bundle\") pod \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\" (UID: \"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95\") "
Jul 23 12:14:26.245323 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.245299    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-bundle" (OuterVolumeSpecName: "bundle") pod "c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" (UID: "c8cf7e6e-d0e8-42ca-a84f-7640ead40e95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:14:26.246936 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.246912    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-kube-api-access-tzr24" (OuterVolumeSpecName: "kube-api-access-tzr24") pod "c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" (UID: "c8cf7e6e-d0e8-42ca-a84f-7640ead40e95"). InnerVolumeSpecName "kube-api-access-tzr24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:14:26.248801 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.248761    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-util" (OuterVolumeSpecName: "util") pod "c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" (UID: "c8cf7e6e-d0e8-42ca-a84f-7640ead40e95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:14:26.346405 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.346313    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzr24\" (UniqueName: \"kubernetes.io/projected/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-kube-api-access-tzr24\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:14:26.346405 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.346345    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-util\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:14:26.346405 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:26.346356    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8cf7e6e-d0e8-42ca-a84f-7640ead40e95-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:14:27.066944 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:27.066852    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5" event={"ID":"c8cf7e6e-d0e8-42ca-a84f-7640ead40e95","Type":"ContainerDied","Data":"435019ba94ba9af1e0307645e942250b24769e0fb4f55a8519f55b6339064b47"}
Jul 23 12:14:27.066944 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:27.066885    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwkz5"
Jul 23 12:14:27.066944 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:27.066910    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="435019ba94ba9af1e0307645e942250b24769e0fb4f55a8519f55b6339064b47"
Jul 23 12:14:27.189545 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:27.189511    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:27.340546 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:27.340438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:29.052996 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:29.052968    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-njkdt"
Jul 23 12:14:29.903024 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:29.902989    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:30.189584 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.189499    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pr7xs"]
Jul 23 12:14:30.189935 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.189818    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerName="util"
Jul 23 12:14:30.189935 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.189831    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerName="util"
Jul 23 12:14:30.189935 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.189839    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerName="pull"
Jul 23 12:14:30.189935 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.189844    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerName="pull"
Jul 23 12:14:30.189935 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.189850    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerName="extract"
Jul 23 12:14:30.189935 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.189858    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerName="extract"
Jul 23 12:14:30.189935 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.189913    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8cf7e6e-d0e8-42ca-a84f-7640ead40e95" containerName="extract"
Jul 23 12:14:30.193788 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.193770    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pr7xs"
Jul 23 12:14:30.196389 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.196360    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gg2vr\""
Jul 23 12:14:30.203996 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.203971    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pr7xs"]
Jul 23 12:14:30.275577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.275536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dzqd\" (UniqueName: \"kubernetes.io/projected/30f962e2-10cc-4462-b395-2bdda7c75d5e-kube-api-access-6dzqd\") pod \"cert-manager-55b4d954d5-pr7xs\" (UID: \"30f962e2-10cc-4462-b395-2bdda7c75d5e\") " pod="cert-manager/cert-manager-55b4d954d5-pr7xs"
Jul 23 12:14:30.275577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.275577    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30f962e2-10cc-4462-b395-2bdda7c75d5e-bound-sa-token\") pod \"cert-manager-55b4d954d5-pr7xs\" (UID: \"30f962e2-10cc-4462-b395-2bdda7c75d5e\") " pod="cert-manager/cert-manager-55b4d954d5-pr7xs"
Jul 23 12:14:30.376419 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.376381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dzqd\" (UniqueName: \"kubernetes.io/projected/30f962e2-10cc-4462-b395-2bdda7c75d5e-kube-api-access-6dzqd\") pod \"cert-manager-55b4d954d5-pr7xs\" (UID: \"30f962e2-10cc-4462-b395-2bdda7c75d5e\") " pod="cert-manager/cert-manager-55b4d954d5-pr7xs"
Jul 23 12:14:30.376419 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.376419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30f962e2-10cc-4462-b395-2bdda7c75d5e-bound-sa-token\") pod \"cert-manager-55b4d954d5-pr7xs\" (UID: \"30f962e2-10cc-4462-b395-2bdda7c75d5e\") " pod="cert-manager/cert-manager-55b4d954d5-pr7xs"
Jul 23 12:14:30.388119 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.388085    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30f962e2-10cc-4462-b395-2bdda7c75d5e-bound-sa-token\") pod \"cert-manager-55b4d954d5-pr7xs\" (UID: \"30f962e2-10cc-4462-b395-2bdda7c75d5e\") " pod="cert-manager/cert-manager-55b4d954d5-pr7xs"
Jul 23 12:14:30.388274 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.388256    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dzqd\" (UniqueName: \"kubernetes.io/projected/30f962e2-10cc-4462-b395-2bdda7c75d5e-kube-api-access-6dzqd\") pod \"cert-manager-55b4d954d5-pr7xs\" (UID: \"30f962e2-10cc-4462-b395-2bdda7c75d5e\") " pod="cert-manager/cert-manager-55b4d954d5-pr7xs"
Jul 23 12:14:30.503032 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.502999    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pr7xs"
Jul 23 12:14:30.632794 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:30.632762    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pr7xs"]
Jul 23 12:14:30.635348 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:14:30.635318    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30f962e2_10cc_4462_b395_2bdda7c75d5e.slice/crio-f9cf18768851a81c762c79ac48d5ba8317ce6f716ceede4514e56367fac58fc3 WatchSource:0}: Error finding container f9cf18768851a81c762c79ac48d5ba8317ce6f716ceede4514e56367fac58fc3: Status 404 returned error can't find the container with id f9cf18768851a81c762c79ac48d5ba8317ce6f716ceede4514e56367fac58fc3
Jul 23 12:14:31.084875 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:31.084836    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pr7xs" event={"ID":"30f962e2-10cc-4462-b395-2bdda7c75d5e","Type":"ContainerStarted","Data":"08627321c60c7fffabfaa2683ae4f98e0b584fbc444a82e4087456a95b74026f"}
Jul 23 12:14:31.085057 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:31.084887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pr7xs" event={"ID":"30f962e2-10cc-4462-b395-2bdda7c75d5e","Type":"ContainerStarted","Data":"f9cf18768851a81c762c79ac48d5ba8317ce6f716ceede4514e56367fac58fc3"}
Jul 23 12:14:31.104313 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:31.104257    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pr7xs" podStartSLOduration=1.1042396 podStartE2EDuration="1.1042396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:14:31.103228803 +0000 UTC m=+272.864348155" watchObservedRunningTime="2026-07-23 12:14:31.1042396 +0000 UTC m=+272.865358950"
Jul 23 12:14:31.879073 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:31.879031    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:31.974105 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:31.974069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:37.326398 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:37.326359    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:37.611733 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:37.611636    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:39.055250 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.055218    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"]
Jul 23 12:14:39.058489 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.058456    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.061136 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.061114    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 12:14:39.061876 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.061862    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 12:14:39.061971 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.061867    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-55mqz\""
Jul 23 12:14:39.070126 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.070101    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"]
Jul 23 12:14:39.146241 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.146201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4q92\" (UniqueName: \"kubernetes.io/projected/833b86f1-90b1-4030-8ada-3edca676fa34-kube-api-access-q4q92\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.146413 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.146256    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.146413 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.146277    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.247528 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.247483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.247528 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.247522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.247779 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.247572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4q92\" (UniqueName: \"kubernetes.io/projected/833b86f1-90b1-4030-8ada-3edca676fa34-kube-api-access-q4q92\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.247935 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.247912    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.247995 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.247920    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.256848 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.256817    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4q92\" (UniqueName: \"kubernetes.io/projected/833b86f1-90b1-4030-8ada-3edca676fa34-kube-api-access-q4q92\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.367535 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.367427    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:39.386333 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.386295    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:39.501708 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:39.501686    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"]
Jul 23 12:14:39.504804 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:14:39.504780    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833b86f1_90b1_4030_8ada_3edca676fa34.slice/crio-6c39d0884e5ef95bfec11d0ce692387324858e3c800fda92f09833dd29e04a74 WatchSource:0}: Error finding container 6c39d0884e5ef95bfec11d0ce692387324858e3c800fda92f09833dd29e04a74: Status 404 returned error can't find the container with id 6c39d0884e5ef95bfec11d0ce692387324858e3c800fda92f09833dd29e04a74
Jul 23 12:14:40.124035 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:40.124003    2570 generic.go:356] "Generic (PLEG): container finished" podID="833b86f1-90b1-4030-8ada-3edca676fa34" containerID="c2a95da0dc0230242c486e0403a46e2fbf5b2cf28ac2bfa27a5ee09a4597e46c" exitCode=0
Jul 23 12:14:40.124446 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:40.124087    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx" event={"ID":"833b86f1-90b1-4030-8ada-3edca676fa34","Type":"ContainerDied","Data":"c2a95da0dc0230242c486e0403a46e2fbf5b2cf28ac2bfa27a5ee09a4597e46c"}
Jul 23 12:14:40.124446 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:40.124152    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx" event={"ID":"833b86f1-90b1-4030-8ada-3edca676fa34","Type":"ContainerStarted","Data":"6c39d0884e5ef95bfec11d0ce692387324858e3c800fda92f09833dd29e04a74"}
Jul 23 12:14:42.136115 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:42.136084    2570 generic.go:356] "Generic (PLEG): container finished" podID="833b86f1-90b1-4030-8ada-3edca676fa34" containerID="2bda94e52450465fac84b7e754d7e415a15449110b3e068dec992f23de1b9867" exitCode=0
Jul 23 12:14:42.136519 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:42.136171    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx" event={"ID":"833b86f1-90b1-4030-8ada-3edca676fa34","Type":"ContainerDied","Data":"2bda94e52450465fac84b7e754d7e415a15449110b3e068dec992f23de1b9867"}
Jul 23 12:14:43.142688 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:43.142653    2570 generic.go:356] "Generic (PLEG): container finished" podID="833b86f1-90b1-4030-8ada-3edca676fa34" containerID="e26bf27967e641f1dcba91757623717c33498a5c83e32c17cdf10dda81b3a414" exitCode=0
Jul 23 12:14:43.143073 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:43.142695    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx" event={"ID":"833b86f1-90b1-4030-8ada-3edca676fa34","Type":"ContainerDied","Data":"e26bf27967e641f1dcba91757623717c33498a5c83e32c17cdf10dda81b3a414"}
Jul 23 12:14:44.267728 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.267705    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:44.390455 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.390424    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4q92\" (UniqueName: \"kubernetes.io/projected/833b86f1-90b1-4030-8ada-3edca676fa34-kube-api-access-q4q92\") pod \"833b86f1-90b1-4030-8ada-3edca676fa34\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") "
Jul 23 12:14:44.390455 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.390460    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-bundle\") pod \"833b86f1-90b1-4030-8ada-3edca676fa34\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") "
Jul 23 12:14:44.390673 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.390506    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-util\") pod \"833b86f1-90b1-4030-8ada-3edca676fa34\" (UID: \"833b86f1-90b1-4030-8ada-3edca676fa34\") "
Jul 23 12:14:44.391256 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.391227    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-bundle" (OuterVolumeSpecName: "bundle") pod "833b86f1-90b1-4030-8ada-3edca676fa34" (UID: "833b86f1-90b1-4030-8ada-3edca676fa34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:14:44.392654 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.392631    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/833b86f1-90b1-4030-8ada-3edca676fa34-kube-api-access-q4q92" (OuterVolumeSpecName: "kube-api-access-q4q92") pod "833b86f1-90b1-4030-8ada-3edca676fa34" (UID: "833b86f1-90b1-4030-8ada-3edca676fa34"). InnerVolumeSpecName "kube-api-access-q4q92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:14:44.396139 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.396107    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-util" (OuterVolumeSpecName: "util") pod "833b86f1-90b1-4030-8ada-3edca676fa34" (UID: "833b86f1-90b1-4030-8ada-3edca676fa34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:14:44.491213 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.491163    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-util\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:14:44.491213 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.491207    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4q92\" (UniqueName: \"kubernetes.io/projected/833b86f1-90b1-4030-8ada-3edca676fa34-kube-api-access-q4q92\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:14:44.491213 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:44.491218    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833b86f1-90b1-4030-8ada-3edca676fa34-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:14:45.152252 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:45.152167    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx" event={"ID":"833b86f1-90b1-4030-8ada-3edca676fa34","Type":"ContainerDied","Data":"6c39d0884e5ef95bfec11d0ce692387324858e3c800fda92f09833dd29e04a74"}
Jul 23 12:14:45.152252 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:45.152199    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhtdzx"
Jul 23 12:14:45.152252 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:45.152238    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c39d0884e5ef95bfec11d0ce692387324858e3c800fda92f09833dd29e04a74"
Jul 23 12:14:55.151509 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:55.151452    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:55.266823 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:55.266782    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:56.412813 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.412780    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"]
Jul 23 12:14:56.413205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.413078    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833b86f1-90b1-4030-8ada-3edca676fa34" containerName="pull"
Jul 23 12:14:56.413205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.413090    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="833b86f1-90b1-4030-8ada-3edca676fa34" containerName="pull"
Jul 23 12:14:56.413205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.413104    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833b86f1-90b1-4030-8ada-3edca676fa34" containerName="extract"
Jul 23 12:14:56.413205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.413109    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="833b86f1-90b1-4030-8ada-3edca676fa34" containerName="extract"
Jul 23 12:14:56.413205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.413119    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833b86f1-90b1-4030-8ada-3edca676fa34" containerName="util"
Jul 23 12:14:56.413205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.413124    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="833b86f1-90b1-4030-8ada-3edca676fa34" containerName="util"
Jul 23 12:14:56.413205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.413177    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="833b86f1-90b1-4030-8ada-3edca676fa34" containerName="extract"
Jul 23 12:14:56.417591 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.417566    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.418509 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.418462    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:56.424777 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:14:56.424733    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-133-105.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-105.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Jul 23 12:14:56.424777 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:14:56.424756    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-105.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-105.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 23 12:14:56.424777 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:14:56.424749    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" is forbidden: User \"system:node:ip-10-0-133-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-105.ec2.internal' and this object" podUID="36d83901-3b86-4e99-bd88-48e62e4524f0" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.425009 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:14:56.424805    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-133-105.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-105.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret"
Jul 23 12:14:56.425009 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:14:56.424831    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-105.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-105.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 23 12:14:56.425009 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:14:56.424846    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-4zrkc\" is forbidden: User \"system:node:ip-10-0-133-105.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-105.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4zrkc\"" type="*v1.Secret"
Jul 23 12:14:56.444623 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.444580    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"]
Jul 23 12:14:56.490996 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.490959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvtp\" (UniqueName: \"kubernetes.io/projected/36d83901-3b86-4e99-bd88-48e62e4524f0-kube-api-access-nqvtp\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.491173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.491021    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36d83901-3b86-4e99-bd88-48e62e4524f0-tmp\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.491173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.491067    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36d83901-3b86-4e99-bd88-48e62e4524f0-manifests\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.491173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.491088    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36d83901-3b86-4e99-bd88-48e62e4524f0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.491173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.491148    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36d83901-3b86-4e99-bd88-48e62e4524f0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.529019 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.528985    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:56.591989 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.591952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvtp\" (UniqueName: \"kubernetes.io/projected/36d83901-3b86-4e99-bd88-48e62e4524f0-kube-api-access-nqvtp\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.592155 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.591999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36d83901-3b86-4e99-bd88-48e62e4524f0-tmp\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.592155 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.592115    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36d83901-3b86-4e99-bd88-48e62e4524f0-manifests\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.592242 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.592157    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36d83901-3b86-4e99-bd88-48e62e4524f0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.592242 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.592219    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36d83901-3b86-4e99-bd88-48e62e4524f0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.592587 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.592562    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36d83901-3b86-4e99-bd88-48e62e4524f0-manifests\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.594251 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.594226    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36d83901-3b86-4e99-bd88-48e62e4524f0-tmp\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:56.640397 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.640359    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:56.741952 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.741922    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:56.848144 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.848099    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:56.947288 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:56.947252    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:57.044831 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:57.044757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:14:57.371266 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:57.371182    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 12:14:57.375546 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:57.375523    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36d83901-3b86-4e99-bd88-48e62e4524f0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:57.375671 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:57.375616    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36d83901-3b86-4e99-bd88-48e62e4524f0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:57.488157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:57.488123    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 12:14:57.601442 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:14:57.601392    2570 projected.go:291] Couldn't get configMap opendatahub/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 23 12:14:57.601442 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:14:57.601446    2570 projected.go:196] Error preparing data for projected volume kube-api-access-nqvtp for pod opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c: failed to sync configmap cache: timed out waiting for the condition
Jul 23 12:14:57.601686 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:14:57.601535    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36d83901-3b86-4e99-bd88-48e62e4524f0-kube-api-access-nqvtp podName:36d83901-3b86-4e99-bd88-48e62e4524f0 nodeName:}" failed. No retries permitted until 2026-07-23 12:14:58.101517377 +0000 UTC m=+299.862636709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nqvtp" (UniqueName: "kubernetes.io/projected/36d83901-3b86-4e99-bd88-48e62e4524f0-kube-api-access-nqvtp") pod "opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c" (UID: "36d83901-3b86-4e99-bd88-48e62e4524f0") : failed to sync configmap cache: timed out waiting for the condition
Jul 23 12:14:57.685146 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:57.685069    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4zrkc\""
Jul 23 12:14:57.938810 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:57.938724    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 12:14:58.001906 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:58.001874    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 12:14:58.104629 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:58.104588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvtp\" (UniqueName: \"kubernetes.io/projected/36d83901-3b86-4e99-bd88-48e62e4524f0-kube-api-access-nqvtp\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:58.107029 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:58.107009    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvtp\" (UniqueName: \"kubernetes.io/projected/36d83901-3b86-4e99-bd88-48e62e4524f0-kube-api-access-nqvtp\") pod \"opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c\" (UID: \"36d83901-3b86-4e99-bd88-48e62e4524f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:58.228282 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:58.228246    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:14:58.380513 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:58.380489    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"]
Jul 23 12:14:58.382607 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:14:58.382582    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d83901_3b86_4e99_bd88_48e62e4524f0.slice/crio-37f9bb73f214bb442dcaa87e1ead5a9ccc9980a7aefc39c45cec95a044d0a49f WatchSource:0}: Error finding container 37f9bb73f214bb442dcaa87e1ead5a9ccc9980a7aefc39c45cec95a044d0a49f: Status 404 returned error can't find the container with id 37f9bb73f214bb442dcaa87e1ead5a9ccc9980a7aefc39c45cec95a044d0a49f
Jul 23 12:14:58.583968 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:58.583872    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:14:58.593915 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:58.593891    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:14:58.594363 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:58.594347    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 12:14:59.217579 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:14:59.217525    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c" event={"ID":"36d83901-3b86-4e99-bd88-48e62e4524f0","Type":"ContainerStarted","Data":"37f9bb73f214bb442dcaa87e1ead5a9ccc9980a7aefc39c45cec95a044d0a49f"}
Jul 23 12:15:01.229531 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:01.229492    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c" event={"ID":"36d83901-3b86-4e99-bd88-48e62e4524f0","Type":"ContainerStarted","Data":"111d79d717b975991b5c1e8c262ad6377818c1a0f26b730a1b594edbdbd3b044"}
Jul 23 12:15:03.239992 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:03.239956    2570 generic.go:356] "Generic (PLEG): container finished" podID="36d83901-3b86-4e99-bd88-48e62e4524f0" containerID="111d79d717b975991b5c1e8c262ad6377818c1a0f26b730a1b594edbdbd3b044" exitCode=0
Jul 23 12:15:03.240433 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:03.240029    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c" event={"ID":"36d83901-3b86-4e99-bd88-48e62e4524f0","Type":"ContainerDied","Data":"111d79d717b975991b5c1e8c262ad6377818c1a0f26b730a1b594edbdbd3b044"}
Jul 23 12:15:03.240664 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:03.240650    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 12:15:03.626837 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:03.626805    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:03.728386 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:03.728354    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:04.246194 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:04.246156    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c" event={"ID":"36d83901-3b86-4e99-bd88-48e62e4524f0","Type":"ContainerStarted","Data":"d24064ae1aee9f2304e0025df91a75190ac42c2f34d2e08d9cde6f21068619bf"}
Jul 23 12:15:04.246609 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:04.246461    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:15:04.269012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:04.268915    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c" podStartSLOduration=4.127402052 podStartE2EDuration="8.2688978s" totalImagesPullingTime="3.101850564s" totalInitContainerRuntime="1.039645184s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:14:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:15:04.268148538 +0000 UTC m=+306.029267912" watchObservedRunningTime="2026-07-23 12:15:04.2688978 +0000 UTC m=+306.030017151"
Jul 23 12:15:09.381290 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:09.381249    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:15.253672 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:15.253643    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c"
Jul 23 12:15:16.938523 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:16.938463    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:17.915588 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.915547    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"]
Jul 23 12:15:17.923583 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.923557    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:17.929090 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.929041    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 12:15:17.929090 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.929089    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kjwnb\""
Jul 23 12:15:17.929327 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.929042    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 12:15:17.941000 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.940969    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"]
Jul 23 12:15:17.967231 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.967188    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-drxt9"]
Jul 23 12:15:17.970649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.970621    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:17.976206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.976183    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jsz6b\""
Jul 23 12:15:17.976358 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.976248    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 12:15:17.998403 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:17.998369    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-drxt9"]
Jul 23 12:15:18.089154 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.089110    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c25e735-4666-4a1e-afdc-e8cb1b0015cb-tmp\") pod \"kube-auth-proxy-5f7c78d7c4-z4k9x\" (UID: \"4c25e735-4666-4a1e-afdc-e8cb1b0015cb\") " pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.089154 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.089154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a90a635-239c-4ab3-9fb9-eb9bbbdfe674-cert\") pod \"odh-model-controller-7998c67dc4-drxt9\" (UID: \"2a90a635-239c-4ab3-9fb9-eb9bbbdfe674\") " pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:18.089402 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.089227    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrvxr\" (UniqueName: \"kubernetes.io/projected/4c25e735-4666-4a1e-afdc-e8cb1b0015cb-kube-api-access-wrvxr\") pod \"kube-auth-proxy-5f7c78d7c4-z4k9x\" (UID: \"4c25e735-4666-4a1e-afdc-e8cb1b0015cb\") " pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.089402 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.089283    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c25e735-4666-4a1e-afdc-e8cb1b0015cb-tls-certs\") pod \"kube-auth-proxy-5f7c78d7c4-z4k9x\" (UID: \"4c25e735-4666-4a1e-afdc-e8cb1b0015cb\") " pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.089402 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.089304    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqn77\" (UniqueName: \"kubernetes.io/projected/2a90a635-239c-4ab3-9fb9-eb9bbbdfe674-kube-api-access-wqn77\") pod \"odh-model-controller-7998c67dc4-drxt9\" (UID: \"2a90a635-239c-4ab3-9fb9-eb9bbbdfe674\") " pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:18.190637 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.190543    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrvxr\" (UniqueName: \"kubernetes.io/projected/4c25e735-4666-4a1e-afdc-e8cb1b0015cb-kube-api-access-wrvxr\") pod \"kube-auth-proxy-5f7c78d7c4-z4k9x\" (UID: \"4c25e735-4666-4a1e-afdc-e8cb1b0015cb\") " pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.190637 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.190610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c25e735-4666-4a1e-afdc-e8cb1b0015cb-tls-certs\") pod \"kube-auth-proxy-5f7c78d7c4-z4k9x\" (UID: \"4c25e735-4666-4a1e-afdc-e8cb1b0015cb\") " pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.190637 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.190630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqn77\" (UniqueName: \"kubernetes.io/projected/2a90a635-239c-4ab3-9fb9-eb9bbbdfe674-kube-api-access-wqn77\") pod \"odh-model-controller-7998c67dc4-drxt9\" (UID: \"2a90a635-239c-4ab3-9fb9-eb9bbbdfe674\") " pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:18.190918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.190664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c25e735-4666-4a1e-afdc-e8cb1b0015cb-tmp\") pod \"kube-auth-proxy-5f7c78d7c4-z4k9x\" (UID: \"4c25e735-4666-4a1e-afdc-e8cb1b0015cb\") " pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.190918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.190694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a90a635-239c-4ab3-9fb9-eb9bbbdfe674-cert\") pod \"odh-model-controller-7998c67dc4-drxt9\" (UID: \"2a90a635-239c-4ab3-9fb9-eb9bbbdfe674\") " pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:18.192984 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.192955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c25e735-4666-4a1e-afdc-e8cb1b0015cb-tmp\") pod \"kube-auth-proxy-5f7c78d7c4-z4k9x\" (UID: \"4c25e735-4666-4a1e-afdc-e8cb1b0015cb\") " pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.193120 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.193039    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c25e735-4666-4a1e-afdc-e8cb1b0015cb-tls-certs\") pod \"kube-auth-proxy-5f7c78d7c4-z4k9x\" (UID: \"4c25e735-4666-4a1e-afdc-e8cb1b0015cb\") " pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.193208 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.193187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a90a635-239c-4ab3-9fb9-eb9bbbdfe674-cert\") pod \"odh-model-controller-7998c67dc4-drxt9\" (UID: \"2a90a635-239c-4ab3-9fb9-eb9bbbdfe674\") " pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:18.203399 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.203373    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqn77\" (UniqueName: \"kubernetes.io/projected/2a90a635-239c-4ab3-9fb9-eb9bbbdfe674-kube-api-access-wqn77\") pod \"odh-model-controller-7998c67dc4-drxt9\" (UID: \"2a90a635-239c-4ab3-9fb9-eb9bbbdfe674\") " pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:18.203530 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.203402    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrvxr\" (UniqueName: \"kubernetes.io/projected/4c25e735-4666-4a1e-afdc-e8cb1b0015cb-kube-api-access-wrvxr\") pod \"kube-auth-proxy-5f7c78d7c4-z4k9x\" (UID: \"4c25e735-4666-4a1e-afdc-e8cb1b0015cb\") " pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.233581 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.233552    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"
Jul 23 12:15:18.281488 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.281442    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:18.385967 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.385922    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x"]
Jul 23 12:15:18.386565 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:15:18.386537    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c25e735_4666_4a1e_afdc_e8cb1b0015cb.slice/crio-52646f56f50628107e7146cbd8a790159e7deec081788b0652f0d65c24d0a280 WatchSource:0}: Error finding container 52646f56f50628107e7146cbd8a790159e7deec081788b0652f0d65c24d0a280: Status 404 returned error can't find the container with id 52646f56f50628107e7146cbd8a790159e7deec081788b0652f0d65c24d0a280
Jul 23 12:15:18.435727 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.435546    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-drxt9"]
Jul 23 12:15:18.438192 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:15:18.438159    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a90a635_239c_4ab3_9fb9_eb9bbbdfe674.slice/crio-3a20434690bdc609856b2ca7b185c6f0a8bbf1cf7530501e4e8c6979a5901911 WatchSource:0}: Error finding container 3a20434690bdc609856b2ca7b185c6f0a8bbf1cf7530501e4e8c6979a5901911: Status 404 returned error can't find the container with id 3a20434690bdc609856b2ca7b185c6f0a8bbf1cf7530501e4e8c6979a5901911
Jul 23 12:15:18.460349 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.460315    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:18.814838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:18.814798    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:19.029874 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:19.029834    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:19.260042 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:19.259998    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:19.318402 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:19.318362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-drxt9" event={"ID":"2a90a635-239c-4ab3-9fb9-eb9bbbdfe674","Type":"ContainerStarted","Data":"3a20434690bdc609856b2ca7b185c6f0a8bbf1cf7530501e4e8c6979a5901911"}
Jul 23 12:15:19.320259 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:19.320210    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x" event={"ID":"4c25e735-4666-4a1e-afdc-e8cb1b0015cb","Type":"ContainerStarted","Data":"52646f56f50628107e7146cbd8a790159e7deec081788b0652f0d65c24d0a280"}
Jul 23 12:15:19.337950 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:19.337881    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:20.426881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:20.426840    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:22.336377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:22.336342    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x" event={"ID":"4c25e735-4666-4a1e-afdc-e8cb1b0015cb","Type":"ContainerStarted","Data":"c70cc44a85e31bac528e45f172f3321839f65a1519c1aa79dd497f81e3c44b9a"}
Jul 23 12:15:22.338002 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:22.337975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-drxt9" event={"ID":"2a90a635-239c-4ab3-9fb9-eb9bbbdfe674","Type":"ContainerStarted","Data":"c3bfef45b5e1a2101752eee0fcb39b48e3d4e5f855c341241548d4edfc752e71"}
Jul 23 12:15:22.338140 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:22.338121    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:22.355583 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:22.355533    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f7c78d7c4-z4k9x" podStartSLOduration=1.845608004 podStartE2EDuration="5.35551631s" totalImagesPullingTime="3.509908306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:15:22.354649368 +0000 UTC m=+324.115768742" watchObservedRunningTime="2026-07-23 12:15:22.35551631 +0000 UTC m=+324.116635670"
Jul 23 12:15:22.373683 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:22.373622    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-drxt9" podStartSLOduration=1.914670375 podStartE2EDuration="5.373604043s" totalImagesPullingTime="3.458933668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:15:22.373049523 +0000 UTC m=+324.134168905" watchObservedRunningTime="2026-07-23 12:15:22.373604043 +0000 UTC m=+324.134723393"
Jul 23 12:15:23.680770 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:23.680730    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:23.771515 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:23.771464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:24.591254 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.591216    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"]
Jul 23 12:15:24.594690 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.594670    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.598038 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.598017    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 12:15:24.598283 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.598265    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8p2td\""
Jul 23 12:15:24.622600 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.622563    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"]
Jul 23 12:15:24.645121 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.645087    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.645279 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.645125    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml96l\" (UniqueName: \"kubernetes.io/projected/ba9cab71-5475-465c-ab5b-aa75d55c5056-kube-api-access-ml96l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.645279 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.645149    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.645279 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.645209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.645279 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.645251    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.645449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.645279    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.645449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.645347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.645449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.645377    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba9cab71-5475-465c-ab5b-aa75d55c5056-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.645449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.645402    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.660921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.660886    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:24.746401 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.746360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.746401 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.746408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.746989 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.746425    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba9cab71-5475-465c-ab5b-aa75d55c5056-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.746989 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.746450    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.746989 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.746522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.746989 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.746546    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml96l\" (UniqueName: \"kubernetes.io/projected/ba9cab71-5475-465c-ab5b-aa75d55c5056-kube-api-access-ml96l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.746989 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.746568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.746989 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.746592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.746989 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.746633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.747394 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.747217    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.747544 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.747314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.747544 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.747359    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.747544 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.747439    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.747671 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.747591    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba9cab71-5475-465c-ab5b-aa75d55c5056-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.749263 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.749239    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.749410 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.749390    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.757532 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.757506    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml96l\" (UniqueName: \"kubernetes.io/projected/ba9cab71-5475-465c-ab5b-aa75d55c5056-kube-api-access-ml96l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.757666 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.757613    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba9cab71-5475-465c-ab5b-aa75d55c5056-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jkwzp\" (UID: \"ba9cab71-5475-465c-ab5b-aa75d55c5056\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:24.860297 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.860204    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:24.904844 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:24.904805    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:25.003021 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.002981    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:25.060297 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.060269    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"]
Jul 23 12:15:25.061463 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:15:25.061438    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9cab71_5475_465c_ab5b_aa75d55c5056.slice/crio-876f6070529ef93ba0a0a1f795d8b914de932d5c60edca8f5a1295963b91e231 WatchSource:0}: Error finding container 876f6070529ef93ba0a0a1f795d8b914de932d5c60edca8f5a1295963b91e231: Status 404 returned error can't find the container with id 876f6070529ef93ba0a0a1f795d8b914de932d5c60edca8f5a1295963b91e231
Jul 23 12:15:25.314518 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.314484    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"]
Jul 23 12:15:25.319137 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.319112    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.322724 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.322698    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 12:15:25.323940 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.323905    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vtwwt\""
Jul 23 12:15:25.324045 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.323944    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 12:15:25.324045 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.323967    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 12:15:25.324045 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.323904    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 12:15:25.324045 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.323906    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 12:15:25.330058 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.330032    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"]
Jul 23 12:15:25.353377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.353347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b786ce42-a908-4e8e-b7c5-f48372fb9799-metrics-cert\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.353590 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.353406    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b786ce42-a908-4e8e-b7c5-f48372fb9799-manager-config\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.353590 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.353527    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzwsg\" (UniqueName: \"kubernetes.io/projected/b786ce42-a908-4e8e-b7c5-f48372fb9799-kube-api-access-kzwsg\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.353590 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.353555    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b786ce42-a908-4e8e-b7c5-f48372fb9799-cert\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.359498 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.359456    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp" event={"ID":"ba9cab71-5475-465c-ab5b-aa75d55c5056","Type":"ContainerStarted","Data":"876f6070529ef93ba0a0a1f795d8b914de932d5c60edca8f5a1295963b91e231"}
Jul 23 12:15:25.455009 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.454966    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b786ce42-a908-4e8e-b7c5-f48372fb9799-manager-config\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.455212 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.455043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwsg\" (UniqueName: \"kubernetes.io/projected/b786ce42-a908-4e8e-b7c5-f48372fb9799-kube-api-access-kzwsg\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.455212 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.455071    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b786ce42-a908-4e8e-b7c5-f48372fb9799-cert\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.455212 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.455113    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b786ce42-a908-4e8e-b7c5-f48372fb9799-metrics-cert\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.455732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.455696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b786ce42-a908-4e8e-b7c5-f48372fb9799-manager-config\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.457591 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.457571    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b786ce42-a908-4e8e-b7c5-f48372fb9799-metrics-cert\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.457684 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.457603    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b786ce42-a908-4e8e-b7c5-f48372fb9799-cert\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.465115 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.465084    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzwsg\" (UniqueName: \"kubernetes.io/projected/b786ce42-a908-4e8e-b7c5-f48372fb9799-kube-api-access-kzwsg\") pod \"lws-controller-manager-7c76dc7d5f-5j2vr\" (UID: \"b786ce42-a908-4e8e-b7c5-f48372fb9799\") " pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.630565 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.630435    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:25.787382 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:25.787356    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"]
Jul 23 12:15:25.790803 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:15:25.790767    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb786ce42_a908_4e8e_b7c5_f48372fb9799.slice/crio-396e47e614902a4bf39ea1552dd0e1fb213cb7273973ba7f3730bee63d58ae6d WatchSource:0}: Error finding container 396e47e614902a4bf39ea1552dd0e1fb213cb7273973ba7f3730bee63d58ae6d: Status 404 returned error can't find the container with id 396e47e614902a4bf39ea1552dd0e1fb213cb7273973ba7f3730bee63d58ae6d
Jul 23 12:15:26.366808 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:26.366767    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr" event={"ID":"b786ce42-a908-4e8e-b7c5-f48372fb9799","Type":"ContainerStarted","Data":"396e47e614902a4bf39ea1552dd0e1fb213cb7273973ba7f3730bee63d58ae6d"}
Jul 23 12:15:28.091108 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.091071    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:15:28.091421 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.091150    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:15:28.091421 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.091176    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:15:28.379621 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.379515    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr" event={"ID":"b786ce42-a908-4e8e-b7c5-f48372fb9799","Type":"ContainerStarted","Data":"1260507fbda52f4d2fce1e2ac43ea62be01e44228e18d0611088d304ddd6305f"}
Jul 23 12:15:28.379621 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.379584    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:15:28.381276 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.381253    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp" event={"ID":"ba9cab71-5475-465c-ab5b-aa75d55c5056","Type":"ContainerStarted","Data":"ef1abee85d6b1343e2c1232490509be7d3c6e3081392868e04a36c134bdd3ef7"}
Jul 23 12:15:28.417355 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.417295    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr" podStartSLOduration=1.120233621 podStartE2EDuration="3.417278649s" totalImagesPullingTime="2.297045028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:15:28.417123525 +0000 UTC m=+330.178242876" watchObservedRunningTime="2026-07-23 12:15:28.417278649 +0000 UTC m=+330.178398000"
Jul 23 12:15:28.529071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.529007    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp" podStartSLOduration=1.501678375 podStartE2EDuration="4.528990716s" totalImagesPullingTime="3.027312341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:15:28.527171142 +0000 UTC m=+330.288290494" watchObservedRunningTime="2026-07-23 12:15:28.528990716 +0000 UTC m=+330.290110066"
Jul 23 12:15:28.905883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.905793    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:28.918543 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:28.918495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:29.020480 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:29.020436    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:29.097712 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:29.097675    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:29.455335 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:29.455303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:29.556907 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:29.556875    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:29.909778 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:29.909748    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:30.246121 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:30.246083    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:30.345747 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:30.345715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:30.391775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:30.391743    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:30.392671 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:30.392653    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jkwzp"
Jul 23 12:15:30.427862 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:30.427791    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:15:33.345385 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:33.345349    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-drxt9"
Jul 23 12:15:39.389132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:15:39.389099    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c76dc7d5f-5j2vr"
Jul 23 12:16:02.458169 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:02.458077    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:02.523463 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:02.523427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:18.834020 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:18.833981    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:19.048627 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:19.048593    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:19.222811 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:19.222778    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:34.224895 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.224856    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"]
Jul 23 12:16:34.228428 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.228410    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.231194 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.231176    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 12:16:34.231306 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.231289    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 12:16:34.231371 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.231306    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-224vt\""
Jul 23 12:16:34.241123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.241104    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"]
Jul 23 12:16:34.390050 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.390018    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.390188 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.390064    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8vfn\" (UniqueName: \"kubernetes.io/projected/3a03ae2b-ecca-4971-92f3-693087b948aa-kube-api-access-n8vfn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.390188 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.390123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.490880 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.490817    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.490880 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.490853    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vfn\" (UniqueName: \"kubernetes.io/projected/3a03ae2b-ecca-4971-92f3-693087b948aa-kube-api-access-n8vfn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.490880 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.490873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.491206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.491187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.491247 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.491215    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.501715 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.501688    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8vfn\" (UniqueName: \"kubernetes.io/projected/3a03ae2b-ecca-4971-92f3-693087b948aa-kube-api-access-n8vfn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.536832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.536810    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:34.671986 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.671959    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"]
Jul 23 12:16:34.673909 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:16:34.673884    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a03ae2b_ecca_4971_92f3_693087b948aa.slice/crio-840261f5238395f9e3fbeedb44d468364445118d8bbfa843d8706e7607dfbe1e WatchSource:0}: Error finding container 840261f5238395f9e3fbeedb44d468364445118d8bbfa843d8706e7607dfbe1e: Status 404 returned error can't find the container with id 840261f5238395f9e3fbeedb44d468364445118d8bbfa843d8706e7607dfbe1e
Jul 23 12:16:34.704701 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:34.704676    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm" event={"ID":"3a03ae2b-ecca-4971-92f3-693087b948aa","Type":"ContainerStarted","Data":"840261f5238395f9e3fbeedb44d468364445118d8bbfa843d8706e7607dfbe1e"}
Jul 23 12:16:35.005084 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.005053    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"]
Jul 23 12:16:35.008497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.008462    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.018892 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.018873    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"]
Jul 23 12:16:35.097287 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.097223    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.097287 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.097262    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.097504 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.097330    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqdmq\" (UniqueName: \"kubernetes.io/projected/56836c27-6df4-4c95-82dd-700ff9099282-kube-api-access-tqdmq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.198538 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.198507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.198672 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.198559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.198672 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.198603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqdmq\" (UniqueName: \"kubernetes.io/projected/56836c27-6df4-4c95-82dd-700ff9099282-kube-api-access-tqdmq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.198865 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.198845    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.198921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.198887    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.208923 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.208896    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqdmq\" (UniqueName: \"kubernetes.io/projected/56836c27-6df4-4c95-82dd-700ff9099282-kube-api-access-tqdmq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.317904 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.317868    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:35.393762 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.393724    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"]
Jul 23 12:16:35.397566 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.397542    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.409249 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.409220    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"]
Jul 23 12:16:35.459177 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.459154    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"]
Jul 23 12:16:35.461085 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:16:35.461049    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56836c27_6df4_4c95_82dd_700ff9099282.slice/crio-c8dc3f1566e4742feea4b5b55525aed65f0e9ded11773431c3a4de7f1f5d9f5b WatchSource:0}: Error finding container c8dc3f1566e4742feea4b5b55525aed65f0e9ded11773431c3a4de7f1f5d9f5b: Status 404 returned error can't find the container with id c8dc3f1566e4742feea4b5b55525aed65f0e9ded11773431c3a4de7f1f5d9f5b
Jul 23 12:16:35.502823 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.502796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.502902 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.502848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrxvz\" (UniqueName: \"kubernetes.io/projected/d67476ef-9729-4675-bc05-e8ab0f0c6100-kube-api-access-jrxvz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.502902 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.502896    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.604424 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.604399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.604554 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.604435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrxvz\" (UniqueName: \"kubernetes.io/projected/d67476ef-9729-4675-bc05-e8ab0f0c6100-kube-api-access-jrxvz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.604554 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.604462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.604840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.604822    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.604876 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.604835    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.613996 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.613969    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrxvz\" (UniqueName: \"kubernetes.io/projected/d67476ef-9729-4675-bc05-e8ab0f0c6100-kube-api-access-jrxvz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.710482 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.710390    2570 generic.go:356] "Generic (PLEG): container finished" podID="56836c27-6df4-4c95-82dd-700ff9099282" containerID="9ec26701ced87166a4cb9cea1430c7bd54a673513ce7b02448a961c58055238e" exitCode=0
Jul 23 12:16:35.710643 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.710493    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w" event={"ID":"56836c27-6df4-4c95-82dd-700ff9099282","Type":"ContainerDied","Data":"9ec26701ced87166a4cb9cea1430c7bd54a673513ce7b02448a961c58055238e"}
Jul 23 12:16:35.710643 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.710540    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w" event={"ID":"56836c27-6df4-4c95-82dd-700ff9099282","Type":"ContainerStarted","Data":"c8dc3f1566e4742feea4b5b55525aed65f0e9ded11773431c3a4de7f1f5d9f5b"}
Jul 23 12:16:35.710643 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.710576    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:35.712238 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.712220    2570 generic.go:356] "Generic (PLEG): container finished" podID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerID="80d5e3142c6cad95f5a5bfd26fa8374ea7ee4064e9c38361d3155c4b48f975ec" exitCode=0
Jul 23 12:16:35.712328 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.712261    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm" event={"ID":"3a03ae2b-ecca-4971-92f3-693087b948aa","Type":"ContainerDied","Data":"80d5e3142c6cad95f5a5bfd26fa8374ea7ee4064e9c38361d3155c4b48f975ec"}
Jul 23 12:16:35.802857 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.802828    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"]
Jul 23 12:16:35.809149 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.809125    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:35.818887 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.818851    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"]
Jul 23 12:16:35.851154 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.851132    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"]
Jul 23 12:16:35.852241 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:16:35.852219    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67476ef_9729_4675_bc05_e8ab0f0c6100.slice/crio-bab7297dac7c55ee9692a4a586fe2e7aab9618be837ca4278b8f7ad10143de48 WatchSource:0}: Error finding container bab7297dac7c55ee9692a4a586fe2e7aab9618be837ca4278b8f7ad10143de48: Status 404 returned error can't find the container with id bab7297dac7c55ee9692a4a586fe2e7aab9618be837ca4278b8f7ad10143de48
Jul 23 12:16:35.906739 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.906720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:35.906848 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.906751    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:35.906848 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:35.906781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhx7\" (UniqueName: \"kubernetes.io/projected/852f4294-9e61-4f11-a6b2-dd21c4949ebf-kube-api-access-tvhx7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:36.008336 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.008308    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:36.008446 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.008348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:36.008507 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.008449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhx7\" (UniqueName: \"kubernetes.io/projected/852f4294-9e61-4f11-a6b2-dd21c4949ebf-kube-api-access-tvhx7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:36.008772 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.008751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:36.008806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.008751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:36.017893 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.017876    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhx7\" (UniqueName: \"kubernetes.io/projected/852f4294-9e61-4f11-a6b2-dd21c4949ebf-kube-api-access-tvhx7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:36.123222 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.123201    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:36.253661 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.253632    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"]
Jul 23 12:16:36.254886 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:16:36.254855    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852f4294_9e61_4f11_a6b2_dd21c4949ebf.slice/crio-aef72cb24f43a52194571e25ebfffa57a1d38bcc946ea27ebbe17b2796a926a8 WatchSource:0}: Error finding container aef72cb24f43a52194571e25ebfffa57a1d38bcc946ea27ebbe17b2796a926a8: Status 404 returned error can't find the container with id aef72cb24f43a52194571e25ebfffa57a1d38bcc946ea27ebbe17b2796a926a8
Jul 23 12:16:36.720637 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.720593    2570 generic.go:356] "Generic (PLEG): container finished" podID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerID="e02336a9d7d7d2ce5478fd15bc54ad49ac09c845a03c739bebecc0fdd444aa57" exitCode=0
Jul 23 12:16:36.720970 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.720737    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c" event={"ID":"852f4294-9e61-4f11-a6b2-dd21c4949ebf","Type":"ContainerDied","Data":"e02336a9d7d7d2ce5478fd15bc54ad49ac09c845a03c739bebecc0fdd444aa57"}
Jul 23 12:16:36.720970 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.720852    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c" event={"ID":"852f4294-9e61-4f11-a6b2-dd21c4949ebf","Type":"ContainerStarted","Data":"aef72cb24f43a52194571e25ebfffa57a1d38bcc946ea27ebbe17b2796a926a8"}
Jul 23 12:16:36.722814 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.722790    2570 generic.go:356] "Generic (PLEG): container finished" podID="56836c27-6df4-4c95-82dd-700ff9099282" containerID="3cf919c8200456deacb9f8380c29877477c10c7910d8387db83ffde797512478" exitCode=0
Jul 23 12:16:36.722933 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.722867    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w" event={"ID":"56836c27-6df4-4c95-82dd-700ff9099282","Type":"ContainerDied","Data":"3cf919c8200456deacb9f8380c29877477c10c7910d8387db83ffde797512478"}
Jul 23 12:16:36.725220 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.725193    2570 generic.go:356] "Generic (PLEG): container finished" podID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerID="4da8e12eeb2eb5bc349e8b0d71a1a94f186064341612c10a558a302830768fb6" exitCode=0
Jul 23 12:16:36.725302 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.725287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n" event={"ID":"d67476ef-9729-4675-bc05-e8ab0f0c6100","Type":"ContainerDied","Data":"4da8e12eeb2eb5bc349e8b0d71a1a94f186064341612c10a558a302830768fb6"}
Jul 23 12:16:36.725358 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:36.725325    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n" event={"ID":"d67476ef-9729-4675-bc05-e8ab0f0c6100","Type":"ContainerStarted","Data":"bab7297dac7c55ee9692a4a586fe2e7aab9618be837ca4278b8f7ad10143de48"}
Jul 23 12:16:37.732789 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:37.732754    2570 generic.go:356] "Generic (PLEG): container finished" podID="56836c27-6df4-4c95-82dd-700ff9099282" containerID="c43bad374dc236b66b5920f6333c5c5e6b4d82ab91807b80babf9e714856277f" exitCode=0
Jul 23 12:16:37.733212 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:37.732850    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w" event={"ID":"56836c27-6df4-4c95-82dd-700ff9099282","Type":"ContainerDied","Data":"c43bad374dc236b66b5920f6333c5c5e6b4d82ab91807b80babf9e714856277f"}
Jul 23 12:16:37.734849 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:37.734829    2570 generic.go:356] "Generic (PLEG): container finished" podID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerID="aa5d51757331028a5e6a2c7246b8acb609dddf468e640cd0b8cdc4d814a31532" exitCode=0
Jul 23 12:16:37.734969 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:37.734908    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm" event={"ID":"3a03ae2b-ecca-4971-92f3-693087b948aa","Type":"ContainerDied","Data":"aa5d51757331028a5e6a2c7246b8acb609dddf468e640cd0b8cdc4d814a31532"}
Jul 23 12:16:37.736912 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:37.736890    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c" event={"ID":"852f4294-9e61-4f11-a6b2-dd21c4949ebf","Type":"ContainerStarted","Data":"27f481a822d6400793706e0747da99b9dbd67ac1b5a25f9f055aa686fcb7b67d"}
Jul 23 12:16:38.743215 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:38.743185    2570 generic.go:356] "Generic (PLEG): container finished" podID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerID="06d03ca0a583aa5e88f96809db338d48859f9d4d7e7e9b016eafdbdcf9055c90" exitCode=0
Jul 23 12:16:38.743584 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:38.743257    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm" event={"ID":"3a03ae2b-ecca-4971-92f3-693087b948aa","Type":"ContainerDied","Data":"06d03ca0a583aa5e88f96809db338d48859f9d4d7e7e9b016eafdbdcf9055c90"}
Jul 23 12:16:38.744953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:38.744935    2570 generic.go:356] "Generic (PLEG): container finished" podID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerID="27f481a822d6400793706e0747da99b9dbd67ac1b5a25f9f055aa686fcb7b67d" exitCode=0
Jul 23 12:16:38.745082 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:38.745016    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c" event={"ID":"852f4294-9e61-4f11-a6b2-dd21c4949ebf","Type":"ContainerDied","Data":"27f481a822d6400793706e0747da99b9dbd67ac1b5a25f9f055aa686fcb7b67d"}
Jul 23 12:16:38.746796 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:38.746775    2570 generic.go:356] "Generic (PLEG): container finished" podID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerID="79ec800e09f5b00fb69993f18a816e1a8122ed854b69a158fc82e49ffa15332e" exitCode=0
Jul 23 12:16:38.746876 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:38.746862    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n" event={"ID":"d67476ef-9729-4675-bc05-e8ab0f0c6100","Type":"ContainerDied","Data":"79ec800e09f5b00fb69993f18a816e1a8122ed854b69a158fc82e49ffa15332e"}
Jul 23 12:16:38.892652 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:38.892631    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:39.030079 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.030019    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-util\") pod \"56836c27-6df4-4c95-82dd-700ff9099282\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") "
Jul 23 12:16:39.030079 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.030055    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-bundle\") pod \"56836c27-6df4-4c95-82dd-700ff9099282\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") "
Jul 23 12:16:39.030204 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.030094    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqdmq\" (UniqueName: \"kubernetes.io/projected/56836c27-6df4-4c95-82dd-700ff9099282-kube-api-access-tqdmq\") pod \"56836c27-6df4-4c95-82dd-700ff9099282\" (UID: \"56836c27-6df4-4c95-82dd-700ff9099282\") "
Jul 23 12:16:39.030718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.030694    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-bundle" (OuterVolumeSpecName: "bundle") pod "56836c27-6df4-4c95-82dd-700ff9099282" (UID: "56836c27-6df4-4c95-82dd-700ff9099282"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:16:39.032221 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.032195    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56836c27-6df4-4c95-82dd-700ff9099282-kube-api-access-tqdmq" (OuterVolumeSpecName: "kube-api-access-tqdmq") pod "56836c27-6df4-4c95-82dd-700ff9099282" (UID: "56836c27-6df4-4c95-82dd-700ff9099282"). InnerVolumeSpecName "kube-api-access-tqdmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:16:39.035386 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.035369    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-util" (OuterVolumeSpecName: "util") pod "56836c27-6df4-4c95-82dd-700ff9099282" (UID: "56836c27-6df4-4c95-82dd-700ff9099282"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:16:39.131039 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.131014    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:39.131039 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.131038    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqdmq\" (UniqueName: \"kubernetes.io/projected/56836c27-6df4-4c95-82dd-700ff9099282-kube-api-access-tqdmq\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:39.131175 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.131047    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56836c27-6df4-4c95-82dd-700ff9099282-util\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:39.753916 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.753888    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w"
Jul 23 12:16:39.754291 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.753882    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w" event={"ID":"56836c27-6df4-4c95-82dd-700ff9099282","Type":"ContainerDied","Data":"c8dc3f1566e4742feea4b5b55525aed65f0e9ded11773431c3a4de7f1f5d9f5b"}
Jul 23 12:16:39.754291 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.754007    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8dc3f1566e4742feea4b5b55525aed65f0e9ded11773431c3a4de7f1f5d9f5b"
Jul 23 12:16:39.756110 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.756086    2570 generic.go:356] "Generic (PLEG): container finished" podID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerID="0265743f85de82f1fc61575f70ad1ac14a10fbdeab6617b58a5833a180fb2055" exitCode=0
Jul 23 12:16:39.756219 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.756121    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n" event={"ID":"d67476ef-9729-4675-bc05-e8ab0f0c6100","Type":"ContainerDied","Data":"0265743f85de82f1fc61575f70ad1ac14a10fbdeab6617b58a5833a180fb2055"}
Jul 23 12:16:39.758217 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.758163    2570 generic.go:356] "Generic (PLEG): container finished" podID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerID="c74b4614c1e66ca313af8ad26d3282b96c4e691d02c5ebc1ffd9049cf0f36a3b" exitCode=0
Jul 23 12:16:39.758314 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.758239    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c" event={"ID":"852f4294-9e61-4f11-a6b2-dd21c4949ebf","Type":"ContainerDied","Data":"c74b4614c1e66ca313af8ad26d3282b96c4e691d02c5ebc1ffd9049cf0f36a3b"}
Jul 23 12:16:39.889714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:39.889690    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:40.038407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.038330    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8vfn\" (UniqueName: \"kubernetes.io/projected/3a03ae2b-ecca-4971-92f3-693087b948aa-kube-api-access-n8vfn\") pod \"3a03ae2b-ecca-4971-92f3-693087b948aa\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") "
Jul 23 12:16:40.038407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.038367    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-util\") pod \"3a03ae2b-ecca-4971-92f3-693087b948aa\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") "
Jul 23 12:16:40.038407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.038393    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-bundle\") pod \"3a03ae2b-ecca-4971-92f3-693087b948aa\" (UID: \"3a03ae2b-ecca-4971-92f3-693087b948aa\") "
Jul 23 12:16:40.038902 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.038877    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-bundle" (OuterVolumeSpecName: "bundle") pod "3a03ae2b-ecca-4971-92f3-693087b948aa" (UID: "3a03ae2b-ecca-4971-92f3-693087b948aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:16:40.040340 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.040317    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a03ae2b-ecca-4971-92f3-693087b948aa-kube-api-access-n8vfn" (OuterVolumeSpecName: "kube-api-access-n8vfn") pod "3a03ae2b-ecca-4971-92f3-693087b948aa" (UID: "3a03ae2b-ecca-4971-92f3-693087b948aa"). InnerVolumeSpecName "kube-api-access-n8vfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:16:40.046451 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.046428    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-util" (OuterVolumeSpecName: "util") pod "3a03ae2b-ecca-4971-92f3-693087b948aa" (UID: "3a03ae2b-ecca-4971-92f3-693087b948aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:16:40.138985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.138958    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8vfn\" (UniqueName: \"kubernetes.io/projected/3a03ae2b-ecca-4971-92f3-693087b948aa-kube-api-access-n8vfn\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:40.138985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.138982    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-util\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:40.139110 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.138992    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a03ae2b-ecca-4971-92f3-693087b948aa-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:40.764417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.764384    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm" event={"ID":"3a03ae2b-ecca-4971-92f3-693087b948aa","Type":"ContainerDied","Data":"840261f5238395f9e3fbeedb44d468364445118d8bbfa843d8706e7607dfbe1e"}
Jul 23 12:16:40.764756 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.764434    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="840261f5238395f9e3fbeedb44d468364445118d8bbfa843d8706e7607dfbe1e"
Jul 23 12:16:40.764756 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.764402    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm"
Jul 23 12:16:40.920373 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.920350    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:40.922847 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:40.922830    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:41.046227 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.046159    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-util\") pod \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") "
Jul 23 12:16:41.046227 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.046194    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-util\") pod \"d67476ef-9729-4675-bc05-e8ab0f0c6100\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") "
Jul 23 12:16:41.046227 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.046212    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-bundle\") pod \"d67476ef-9729-4675-bc05-e8ab0f0c6100\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") "
Jul 23 12:16:41.046441 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.046271    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-bundle\") pod \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") "
Jul 23 12:16:41.046441 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.046302    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvhx7\" (UniqueName: \"kubernetes.io/projected/852f4294-9e61-4f11-a6b2-dd21c4949ebf-kube-api-access-tvhx7\") pod \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\" (UID: \"852f4294-9e61-4f11-a6b2-dd21c4949ebf\") "
Jul 23 12:16:41.046441 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.046331    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrxvz\" (UniqueName: \"kubernetes.io/projected/d67476ef-9729-4675-bc05-e8ab0f0c6100-kube-api-access-jrxvz\") pod \"d67476ef-9729-4675-bc05-e8ab0f0c6100\" (UID: \"d67476ef-9729-4675-bc05-e8ab0f0c6100\") "
Jul 23 12:16:41.046773 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.046741    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-bundle" (OuterVolumeSpecName: "bundle") pod "852f4294-9e61-4f11-a6b2-dd21c4949ebf" (UID: "852f4294-9e61-4f11-a6b2-dd21c4949ebf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:16:41.046895 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.046868    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-bundle" (OuterVolumeSpecName: "bundle") pod "d67476ef-9729-4675-bc05-e8ab0f0c6100" (UID: "d67476ef-9729-4675-bc05-e8ab0f0c6100"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:16:41.048508 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.048456    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67476ef-9729-4675-bc05-e8ab0f0c6100-kube-api-access-jrxvz" (OuterVolumeSpecName: "kube-api-access-jrxvz") pod "d67476ef-9729-4675-bc05-e8ab0f0c6100" (UID: "d67476ef-9729-4675-bc05-e8ab0f0c6100"). InnerVolumeSpecName "kube-api-access-jrxvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:16:41.048611 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.048502    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/852f4294-9e61-4f11-a6b2-dd21c4949ebf-kube-api-access-tvhx7" (OuterVolumeSpecName: "kube-api-access-tvhx7") pod "852f4294-9e61-4f11-a6b2-dd21c4949ebf" (UID: "852f4294-9e61-4f11-a6b2-dd21c4949ebf"). InnerVolumeSpecName "kube-api-access-tvhx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:16:41.052032 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.051997    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-util" (OuterVolumeSpecName: "util") pod "852f4294-9e61-4f11-a6b2-dd21c4949ebf" (UID: "852f4294-9e61-4f11-a6b2-dd21c4949ebf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:16:41.054147 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.054126    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-util" (OuterVolumeSpecName: "util") pod "d67476ef-9729-4675-bc05-e8ab0f0c6100" (UID: "d67476ef-9729-4675-bc05-e8ab0f0c6100"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:16:41.147682 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.147653    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-util\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:41.147682 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.147678    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-util\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:41.147682 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.147686    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d67476ef-9729-4675-bc05-e8ab0f0c6100-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:41.147867 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.147694    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852f4294-9e61-4f11-a6b2-dd21c4949ebf-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:41.147867 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.147702    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvhx7\" (UniqueName: \"kubernetes.io/projected/852f4294-9e61-4f11-a6b2-dd21c4949ebf-kube-api-access-tvhx7\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:41.147867 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.147710    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrxvz\" (UniqueName: \"kubernetes.io/projected/d67476ef-9729-4675-bc05-e8ab0f0c6100-kube-api-access-jrxvz\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:16:41.770793 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.770762    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c"
Jul 23 12:16:41.771224 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.770763    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c" event={"ID":"852f4294-9e61-4f11-a6b2-dd21c4949ebf","Type":"ContainerDied","Data":"aef72cb24f43a52194571e25ebfffa57a1d38bcc946ea27ebbe17b2796a926a8"}
Jul 23 12:16:41.771224 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.770892    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aef72cb24f43a52194571e25ebfffa57a1d38bcc946ea27ebbe17b2796a926a8"
Jul 23 12:16:41.772600 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.772577    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n" event={"ID":"d67476ef-9729-4675-bc05-e8ab0f0c6100","Type":"ContainerDied","Data":"bab7297dac7c55ee9692a4a586fe2e7aab9618be837ca4278b8f7ad10143de48"}
Jul 23 12:16:41.772717 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.772610    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bab7297dac7c55ee9692a4a586fe2e7aab9618be837ca4278b8f7ad10143de48"
Jul 23 12:16:41.772717 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:41.772618    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n"
Jul 23 12:16:47.772079 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:47.772046    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:48.549004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:48.548974    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:48.647064 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:48.647031    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:51.380508 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:51.380454    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:54.396173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:54.396136    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:55.011748 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:55.011720    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:55.840732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:55.840691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:56.178570 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:56.178485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:56.812968 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:56.812934    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:59.233192 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:59.233158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:59.233712 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:59.233688    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c86c9786c-mzn7z"]
Jul 23 12:16:59.332942 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:59.332901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:59.430806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:59.430768    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:59.576733 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:59.576656    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:16:59.679941 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:16:59.679916    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:00.882639 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:00.882607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:02.043316 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:02.043280    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:04.129847 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:04.129812    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:04.207271 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:04.207240    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:04.261112 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:04.261065    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:04.330397 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:04.330364    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:04.641845 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:04.641803    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:04.744768 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:04.744736    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:06.714748 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:06.714709    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:06.773153 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:06.773120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:07.188924 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:07.188843    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:07.289585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:07.289552    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:16.599968 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:16.599933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:16.699884 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:16.699853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:19.619693 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:19.619658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:19.718971 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:19.718926    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:22.201042 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:22.200945    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:22.303190 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:22.303154    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:24.253797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.253740    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c86c9786c-mzn7z" podUID="ce2a3635-bc8f-476e-9840-fb343a6e94f5" containerName="console" containerID="cri-o://dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1" gracePeriod=15
Jul 23 12:17:24.498879 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.498858    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:17:24.584816 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.584758    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-serving-cert\") pod \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") "
Jul 23 12:17:24.584816 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.584788    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-oauth-serving-cert\") pod \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") "
Jul 23 12:17:24.584985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.584819    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-service-ca\") pod \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") "
Jul 23 12:17:24.584985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.584849    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk8pk\" (UniqueName: \"kubernetes.io/projected/ce2a3635-bc8f-476e-9840-fb343a6e94f5-kube-api-access-wk8pk\") pod \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") "
Jul 23 12:17:24.584985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.584890    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-trusted-ca-bundle\") pod \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") "
Jul 23 12:17:24.584985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.584905    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-oauth-config\") pod \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") "
Jul 23 12:17:24.585200 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.585039    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-config\") pod \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\" (UID: \"ce2a3635-bc8f-476e-9840-fb343a6e94f5\") "
Jul 23 12:17:24.585200 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.585175    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ce2a3635-bc8f-476e-9840-fb343a6e94f5" (UID: "ce2a3635-bc8f-476e-9840-fb343a6e94f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:17:24.585367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.585338    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ce2a3635-bc8f-476e-9840-fb343a6e94f5" (UID: "ce2a3635-bc8f-476e-9840-fb343a6e94f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:17:24.585367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.585240    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "ce2a3635-bc8f-476e-9840-fb343a6e94f5" (UID: "ce2a3635-bc8f-476e-9840-fb343a6e94f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:17:24.585561 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.585409    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-config" (OuterVolumeSpecName: "console-config") pod "ce2a3635-bc8f-476e-9840-fb343a6e94f5" (UID: "ce2a3635-bc8f-476e-9840-fb343a6e94f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:17:24.585678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.585659    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-config\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:17:24.585721 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.585685    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-oauth-serving-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:17:24.585721 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.585699    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-service-ca\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:17:24.585721 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.585713    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce2a3635-bc8f-476e-9840-fb343a6e94f5-trusted-ca-bundle\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:17:24.587012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.586990    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ce2a3635-bc8f-476e-9840-fb343a6e94f5" (UID: "ce2a3635-bc8f-476e-9840-fb343a6e94f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:17:24.587091 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.587040    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce2a3635-bc8f-476e-9840-fb343a6e94f5-kube-api-access-wk8pk" (OuterVolumeSpecName: "kube-api-access-wk8pk") pod "ce2a3635-bc8f-476e-9840-fb343a6e94f5" (UID: "ce2a3635-bc8f-476e-9840-fb343a6e94f5"). InnerVolumeSpecName "kube-api-access-wk8pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:17:24.587091 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.587059    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ce2a3635-bc8f-476e-9840-fb343a6e94f5" (UID: "ce2a3635-bc8f-476e-9840-fb343a6e94f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:17:24.686353 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.686330    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-serving-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:17:24.686353 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.686351    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk8pk\" (UniqueName: \"kubernetes.io/projected/ce2a3635-bc8f-476e-9840-fb343a6e94f5-kube-api-access-wk8pk\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:17:24.686509 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.686364    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce2a3635-bc8f-476e-9840-fb343a6e94f5-console-oauth-config\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:17:24.977580 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.977553    2570 generic.go:356] "Generic (PLEG): container finished" podID="ce2a3635-bc8f-476e-9840-fb343a6e94f5" containerID="dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1" exitCode=0
Jul 23 12:17:24.977710 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.977592    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c86c9786c-mzn7z"
Jul 23 12:17:24.977710 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.977649    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c86c9786c-mzn7z" event={"ID":"ce2a3635-bc8f-476e-9840-fb343a6e94f5","Type":"ContainerDied","Data":"dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1"}
Jul 23 12:17:24.977710 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.977696    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c86c9786c-mzn7z" event={"ID":"ce2a3635-bc8f-476e-9840-fb343a6e94f5","Type":"ContainerDied","Data":"69913b40a4d05b873fe439341b106e28ee8e4ee47152ecf84b79d0ef85340110"}
Jul 23 12:17:24.977841 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.977719    2570 scope.go:117] "RemoveContainer" containerID="dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1"
Jul 23 12:17:24.986022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.986005    2570 scope.go:117] "RemoveContainer" containerID="dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1"
Jul 23 12:17:24.986271 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:17:24.986252    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1\": container with ID starting with dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1 not found: ID does not exist" containerID="dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1"
Jul 23 12:17:24.986328 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:24.986281    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1"} err="failed to get container status \"dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1\": rpc error: code = NotFound desc = could not find container \"dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1\": container with ID starting with dc3f18fde36fe1d529f578a6bbb488ebf4e068394c08a67d455469030c7d6ec1 not found: ID does not exist"
Jul 23 12:17:25.000053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:25.000031    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c86c9786c-mzn7z"]
Jul 23 12:17:25.004594 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:25.004576    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c86c9786c-mzn7z"]
Jul 23 12:17:26.003979 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:26.003951    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:26.109110 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:26.109078    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:26.737700 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:26.737670    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce2a3635-bc8f-476e-9840-fb343a6e94f5" path="/var/lib/kubelet/pods/ce2a3635-bc8f-476e-9840-fb343a6e94f5/volumes"
Jul 23 12:17:36.003705 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:36.003670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:36.101579 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:36.101546    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:39.023667 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:39.023632    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:39.123610 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:39.123569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:47.869268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:47.869230    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:17:48.080724 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:17:48.080685    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:01.674579 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:01.674533    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:01.776646 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:01.776601    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:01.880013 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:01.879982    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:02.519535 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519500    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4rdr9"]
Jul 23 12:18:02.519830 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519819    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerName="extract"
Jul 23 12:18:02.519881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519831    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerName="extract"
Jul 23 12:18:02.519881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519841    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56836c27-6df4-4c95-82dd-700ff9099282" containerName="util"
Jul 23 12:18:02.519881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519847    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56836c27-6df4-4c95-82dd-700ff9099282" containerName="util"
Jul 23 12:18:02.519881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519854    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerName="util"
Jul 23 12:18:02.519881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519860    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerName="util"
Jul 23 12:18:02.519881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519866    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerName="pull"
Jul 23 12:18:02.519881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519871    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerName="pull"
Jul 23 12:18:02.519881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519878    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerName="util"
Jul 23 12:18:02.519881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519883    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerName="util"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519890    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56836c27-6df4-4c95-82dd-700ff9099282" containerName="pull"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519895    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56836c27-6df4-4c95-82dd-700ff9099282" containerName="pull"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519900    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerName="pull"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519905    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerName="pull"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519913    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerName="util"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519917    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerName="util"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519924    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56836c27-6df4-4c95-82dd-700ff9099282" containerName="extract"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519929    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56836c27-6df4-4c95-82dd-700ff9099282" containerName="extract"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519937    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce2a3635-bc8f-476e-9840-fb343a6e94f5" containerName="console"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519942    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce2a3635-bc8f-476e-9840-fb343a6e94f5" containerName="console"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519951    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerName="pull"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519956    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerName="pull"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519961    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerName="extract"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519966    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerName="extract"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519971    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerName="extract"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.519976    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerName="extract"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.520044    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="56836c27-6df4-4c95-82dd-700ff9099282" containerName="extract"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.520059    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce2a3635-bc8f-476e-9840-fb343a6e94f5" containerName="console"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.520068    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="852f4294-9e61-4f11-a6b2-dd21c4949ebf" containerName="extract"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.520074    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a03ae2b-ecca-4971-92f3-693087b948aa" containerName="extract"
Jul 23 12:18:02.520162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.520082    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67476ef-9729-4675-bc05-e8ab0f0c6100" containerName="extract"
Jul 23 12:18:02.524195 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.524179    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4rdr9"
Jul 23 12:18:02.526737 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.526711    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 12:18:02.527661 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.527641    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tn957\""
Jul 23 12:18:02.527766 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.527645    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 12:18:02.531983 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.531959    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4rdr9"]
Jul 23 12:18:02.550900 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.550870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:02.657116 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.657093    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:02.657230 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.657202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qdz\" (UniqueName: \"kubernetes.io/projected/136bfbf3-dac7-4fb9-9236-be10ff7f23dd-kube-api-access-x4qdz\") pod \"authorino-58cd955675-4rdr9\" (UID: \"136bfbf3-dac7-4fb9-9236-be10ff7f23dd\") " pod="kuadrant-system/authorino-58cd955675-4rdr9"
Jul 23 12:18:02.749382 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.749359    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hqhmd"]
Jul 23 12:18:02.752610 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.752595    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hqhmd"
Jul 23 12:18:02.757712 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.757690    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qdz\" (UniqueName: \"kubernetes.io/projected/136bfbf3-dac7-4fb9-9236-be10ff7f23dd-kube-api-access-x4qdz\") pod \"authorino-58cd955675-4rdr9\" (UID: \"136bfbf3-dac7-4fb9-9236-be10ff7f23dd\") " pod="kuadrant-system/authorino-58cd955675-4rdr9"
Jul 23 12:18:02.762045 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.762027    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hqhmd"]
Jul 23 12:18:02.766782 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.766764    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qdz\" (UniqueName: \"kubernetes.io/projected/136bfbf3-dac7-4fb9-9236-be10ff7f23dd-kube-api-access-x4qdz\") pod \"authorino-58cd955675-4rdr9\" (UID: \"136bfbf3-dac7-4fb9-9236-be10ff7f23dd\") " pod="kuadrant-system/authorino-58cd955675-4rdr9"
Jul 23 12:18:02.833563 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.833503    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4rdr9"
Jul 23 12:18:02.858639 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.858612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl9ff\" (UniqueName: \"kubernetes.io/projected/fd55139e-9b51-4d1d-95a3-f489e6335847-kube-api-access-gl9ff\") pod \"authorino-75d556bd77-hqhmd\" (UID: \"fd55139e-9b51-4d1d-95a3-f489e6335847\") " pod="kuadrant-system/authorino-75d556bd77-hqhmd"
Jul 23 12:18:02.959867 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.959835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl9ff\" (UniqueName: \"kubernetes.io/projected/fd55139e-9b51-4d1d-95a3-f489e6335847-kube-api-access-gl9ff\") pod \"authorino-75d556bd77-hqhmd\" (UID: \"fd55139e-9b51-4d1d-95a3-f489e6335847\") " pod="kuadrant-system/authorino-75d556bd77-hqhmd"
Jul 23 12:18:02.961193 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.961170    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4rdr9"]
Jul 23 12:18:02.965017 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:18:02.964993    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod136bfbf3_dac7_4fb9_9236_be10ff7f23dd.slice/crio-f6460c5bd59965f80dc02be088e55bbb9a6f5994b10d59571e772fd84e1c216f WatchSource:0}: Error finding container f6460c5bd59965f80dc02be088e55bbb9a6f5994b10d59571e772fd84e1c216f: Status 404 returned error can't find the container with id f6460c5bd59965f80dc02be088e55bbb9a6f5994b10d59571e772fd84e1c216f
Jul 23 12:18:02.969114 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:02.969089    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl9ff\" (UniqueName: \"kubernetes.io/projected/fd55139e-9b51-4d1d-95a3-f489e6335847-kube-api-access-gl9ff\") pod \"authorino-75d556bd77-hqhmd\" (UID: \"fd55139e-9b51-4d1d-95a3-f489e6335847\") " pod="kuadrant-system/authorino-75d556bd77-hqhmd"
Jul 23 12:18:03.061111 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:03.061088    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hqhmd"
Jul 23 12:18:03.163001 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:03.162959    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4rdr9" event={"ID":"136bfbf3-dac7-4fb9-9236-be10ff7f23dd","Type":"ContainerStarted","Data":"f6460c5bd59965f80dc02be088e55bbb9a6f5994b10d59571e772fd84e1c216f"}
Jul 23 12:18:03.185630 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:03.185609    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hqhmd"]
Jul 23 12:18:03.187556 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:18:03.187513    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd55139e_9b51_4d1d_95a3_f489e6335847.slice/crio-22e836d4c0808b7c6aeefab9bb20dd43005e4abe1977e4f3ba6b125feaa1d7a4 WatchSource:0}: Error finding container 22e836d4c0808b7c6aeefab9bb20dd43005e4abe1977e4f3ba6b125feaa1d7a4: Status 404 returned error can't find the container with id 22e836d4c0808b7c6aeefab9bb20dd43005e4abe1977e4f3ba6b125feaa1d7a4
Jul 23 12:18:04.178986 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:04.178897    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hqhmd" event={"ID":"fd55139e-9b51-4d1d-95a3-f489e6335847","Type":"ContainerStarted","Data":"22e836d4c0808b7c6aeefab9bb20dd43005e4abe1977e4f3ba6b125feaa1d7a4"}
Jul 23 12:18:07.197795 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:07.197686    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hqhmd" event={"ID":"fd55139e-9b51-4d1d-95a3-f489e6335847","Type":"ContainerStarted","Data":"2e660ce34efc4e6227373bb87ef83b09383a779b67eabf1dbd5f6fb138d338dc"}
Jul 23 12:18:07.199158 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:07.199136    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4rdr9" event={"ID":"136bfbf3-dac7-4fb9-9236-be10ff7f23dd","Type":"ContainerStarted","Data":"852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948"}
Jul 23 12:18:07.217916 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:07.217872    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hqhmd" podStartSLOduration=1.565228341 podStartE2EDuration="5.217857908s" totalImagesPullingTime="3.652629567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:18:07.216194817 +0000 UTC m=+488.977314168" watchObservedRunningTime="2026-07-23 12:18:07.217857908 +0000 UTC m=+488.978977301"
Jul 23 12:18:07.243325 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:07.243269    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4rdr9" podStartSLOduration=1.3791827030000001 podStartE2EDuration="5.243250809s" totalImagesPullingTime="3.864068106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:18:07.242398797 +0000 UTC m=+489.003518147" watchObservedRunningTime="2026-07-23 12:18:07.243250809 +0000 UTC m=+489.004370161"
Jul 23 12:18:07.251549 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:07.251522    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4rdr9"]
Jul 23 12:18:09.208463 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:09.208423    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4rdr9" podUID="136bfbf3-dac7-4fb9-9236-be10ff7f23dd" containerName="authorino" containerID="cri-o://852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948" gracePeriod=30
Jul 23 12:18:09.448154 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:09.448124    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4rdr9"
Jul 23 12:18:09.517836 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:09.517806    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4qdz\" (UniqueName: \"kubernetes.io/projected/136bfbf3-dac7-4fb9-9236-be10ff7f23dd-kube-api-access-x4qdz\") pod \"136bfbf3-dac7-4fb9-9236-be10ff7f23dd\" (UID: \"136bfbf3-dac7-4fb9-9236-be10ff7f23dd\") "
Jul 23 12:18:09.519885 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:09.519855    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136bfbf3-dac7-4fb9-9236-be10ff7f23dd-kube-api-access-x4qdz" (OuterVolumeSpecName: "kube-api-access-x4qdz") pod "136bfbf3-dac7-4fb9-9236-be10ff7f23dd" (UID: "136bfbf3-dac7-4fb9-9236-be10ff7f23dd"). InnerVolumeSpecName "kube-api-access-x4qdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:18:09.618759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:09.618723    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4qdz\" (UniqueName: \"kubernetes.io/projected/136bfbf3-dac7-4fb9-9236-be10ff7f23dd-kube-api-access-x4qdz\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:18:10.214887 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.214851    2570 generic.go:356] "Generic (PLEG): container finished" podID="136bfbf3-dac7-4fb9-9236-be10ff7f23dd" containerID="852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948" exitCode=0
Jul 23 12:18:10.214887 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.214893    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4rdr9"
Jul 23 12:18:10.215320 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.214944    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4rdr9" event={"ID":"136bfbf3-dac7-4fb9-9236-be10ff7f23dd","Type":"ContainerDied","Data":"852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948"}
Jul 23 12:18:10.215320 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.214991    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4rdr9" event={"ID":"136bfbf3-dac7-4fb9-9236-be10ff7f23dd","Type":"ContainerDied","Data":"f6460c5bd59965f80dc02be088e55bbb9a6f5994b10d59571e772fd84e1c216f"}
Jul 23 12:18:10.215320 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.215014    2570 scope.go:117] "RemoveContainer" containerID="852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948"
Jul 23 12:18:10.223667 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.223646    2570 scope.go:117] "RemoveContainer" containerID="852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948"
Jul 23 12:18:10.223940 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:18:10.223922    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948\": container with ID starting with 852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948 not found: ID does not exist" containerID="852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948"
Jul 23 12:18:10.224009 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.223949    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948"} err="failed to get container status \"852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948\": rpc error: code = NotFound desc = could not find container \"852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948\": container with ID starting with 852397bd94e41624732f68b6cb2233ee2f047e5e46594fd844f3988636a96948 not found: ID does not exist"
Jul 23 12:18:10.240452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.240429    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4rdr9"]
Jul 23 12:18:10.245333 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.245315    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4rdr9"]
Jul 23 12:18:10.737893 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:10.737864    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136bfbf3-dac7-4fb9-9236-be10ff7f23dd" path="/var/lib/kubelet/pods/136bfbf3-dac7-4fb9-9236-be10ff7f23dd/volumes"
Jul 23 12:18:22.960444 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:22.960404    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:23.061025 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:23.060983    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:23.472716 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:23.472680    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:36.409405 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:36.409369    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:36.945641 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:36.945601    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b98dfcd88-wgvbk"]
Jul 23 12:18:36.945963 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:36.945950    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136bfbf3-dac7-4fb9-9236-be10ff7f23dd" containerName="authorino"
Jul 23 12:18:36.946006 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:36.945966    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="136bfbf3-dac7-4fb9-9236-be10ff7f23dd" containerName="authorino"
Jul 23 12:18:36.946041 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:36.946019    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="136bfbf3-dac7-4fb9-9236-be10ff7f23dd" containerName="authorino"
Jul 23 12:18:36.991357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:36.991320    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b98dfcd88-wgvbk"]
Jul 23 12:18:36.991542 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:36.991526    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk"
Jul 23 12:18:37.048882 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:37.048855    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:37.059130 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:37.059098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm6xz\" (UniqueName: \"kubernetes.io/projected/11bf7b78-f461-4405-a811-0d22a246489b-kube-api-access-bm6xz\") pod \"authorino-6b98dfcd88-wgvbk\" (UID: \"11bf7b78-f461-4405-a811-0d22a246489b\") " pod="kuadrant-system/authorino-6b98dfcd88-wgvbk"
Jul 23 12:18:37.159916 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:37.159815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm6xz\" (UniqueName: \"kubernetes.io/projected/11bf7b78-f461-4405-a811-0d22a246489b-kube-api-access-bm6xz\") pod \"authorino-6b98dfcd88-wgvbk\" (UID: \"11bf7b78-f461-4405-a811-0d22a246489b\") " pod="kuadrant-system/authorino-6b98dfcd88-wgvbk"
Jul 23 12:18:37.169604 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:37.169578    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm6xz\" (UniqueName: \"kubernetes.io/projected/11bf7b78-f461-4405-a811-0d22a246489b-kube-api-access-bm6xz\") pod \"authorino-6b98dfcd88-wgvbk\" (UID: \"11bf7b78-f461-4405-a811-0d22a246489b\") " pod="kuadrant-system/authorino-6b98dfcd88-wgvbk"
Jul 23 12:18:37.299886 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:37.299846    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk"
Jul 23 12:18:37.398224 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:37.398181    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b98dfcd88-wgvbk"]
Jul 23 12:18:37.438716 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:37.438691    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b98dfcd88-wgvbk"]
Jul 23 12:18:37.440835 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:18:37.440803    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11bf7b78_f461_4405_a811_0d22a246489b.slice/crio-2d19783f4a5f66b1fffcafa3923840fa4a91c991210beccc76c788d8c56e64e1 WatchSource:0}: Error finding container 2d19783f4a5f66b1fffcafa3923840fa4a91c991210beccc76c788d8c56e64e1: Status 404 returned error can't find the container with id 2d19783f4a5f66b1fffcafa3923840fa4a91c991210beccc76c788d8c56e64e1
Jul 23 12:18:38.365079 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:38.365050    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk" event={"ID":"11bf7b78-f461-4405-a811-0d22a246489b","Type":"ContainerStarted","Data":"2d19783f4a5f66b1fffcafa3923840fa4a91c991210beccc76c788d8c56e64e1"}
Jul 23 12:18:39.371067 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:39.371030    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk" event={"ID":"11bf7b78-f461-4405-a811-0d22a246489b","Type":"ContainerStarted","Data":"1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5"}
Jul 23 12:18:39.371459 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:39.371100    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk" podUID="11bf7b78-f461-4405-a811-0d22a246489b" containerName="authorino" containerID="cri-o://1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5" gracePeriod=30
Jul 23 12:18:39.389973 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:39.389928    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk" podStartSLOduration=2.480385145 podStartE2EDuration="3.389910092s" totalImagesPullingTime="909.524947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:18:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:18:39.388760418 +0000 UTC m=+521.149879770" watchObservedRunningTime="2026-07-23 12:18:39.389910092 +0000 UTC m=+521.151029447"
Jul 23 12:18:39.613658 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:39.613625    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk"
Jul 23 12:18:39.681073 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:39.680974    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm6xz\" (UniqueName: \"kubernetes.io/projected/11bf7b78-f461-4405-a811-0d22a246489b-kube-api-access-bm6xz\") pod \"11bf7b78-f461-4405-a811-0d22a246489b\" (UID: \"11bf7b78-f461-4405-a811-0d22a246489b\") "
Jul 23 12:18:39.683032 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:39.682994    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11bf7b78-f461-4405-a811-0d22a246489b-kube-api-access-bm6xz" (OuterVolumeSpecName: "kube-api-access-bm6xz") pod "11bf7b78-f461-4405-a811-0d22a246489b" (UID: "11bf7b78-f461-4405-a811-0d22a246489b"). InnerVolumeSpecName "kube-api-access-bm6xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:18:39.781880 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:39.781831    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm6xz\" (UniqueName: \"kubernetes.io/projected/11bf7b78-f461-4405-a811-0d22a246489b-kube-api-access-bm6xz\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:18:40.376589 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.376557    2570 generic.go:356] "Generic (PLEG): container finished" podID="11bf7b78-f461-4405-a811-0d22a246489b" containerID="1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5" exitCode=0
Jul 23 12:18:40.376991 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.376596    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk"
Jul 23 12:18:40.376991 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.376643    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk" event={"ID":"11bf7b78-f461-4405-a811-0d22a246489b","Type":"ContainerDied","Data":"1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5"}
Jul 23 12:18:40.376991 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.376684    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b98dfcd88-wgvbk" event={"ID":"11bf7b78-f461-4405-a811-0d22a246489b","Type":"ContainerDied","Data":"2d19783f4a5f66b1fffcafa3923840fa4a91c991210beccc76c788d8c56e64e1"}
Jul 23 12:18:40.376991 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.376702    2570 scope.go:117] "RemoveContainer" containerID="1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5"
Jul 23 12:18:40.385255 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.385237    2570 scope.go:117] "RemoveContainer" containerID="1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5"
Jul 23 12:18:40.385534 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:18:40.385514    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5\": container with ID starting with 1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5 not found: ID does not exist" containerID="1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5"
Jul 23 12:18:40.385618 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.385541    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5"} err="failed to get container status \"1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5\": rpc error: code = NotFound desc = could not find container \"1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5\": container with ID starting with 1f85be610913c7bb90d1c4b6ca3abe3c16ceedb6ab76824621a45f30dda0beb5 not found: ID does not exist"
Jul 23 12:18:40.398864 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.398838    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b98dfcd88-wgvbk"]
Jul 23 12:18:40.401308 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.401282    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b98dfcd88-wgvbk"]
Jul 23 12:18:40.738043 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:40.738011    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11bf7b78-f461-4405-a811-0d22a246489b" path="/var/lib/kubelet/pods/11bf7b78-f461-4405-a811-0d22a246489b/volumes"
Jul 23 12:18:41.161928 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:41.161830    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hqhmd"]
Jul 23 12:18:41.162102 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:41.162062    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hqhmd" podUID="fd55139e-9b51-4d1d-95a3-f489e6335847" containerName="authorino" containerID="cri-o://2e660ce34efc4e6227373bb87ef83b09383a779b67eabf1dbd5f6fb138d338dc" gracePeriod=30
Jul 23 12:18:41.384626 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:41.384590    2570 generic.go:356] "Generic (PLEG): container finished" podID="fd55139e-9b51-4d1d-95a3-f489e6335847" containerID="2e660ce34efc4e6227373bb87ef83b09383a779b67eabf1dbd5f6fb138d338dc" exitCode=0
Jul 23 12:18:41.385051 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:41.384657    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hqhmd" event={"ID":"fd55139e-9b51-4d1d-95a3-f489e6335847","Type":"ContainerDied","Data":"2e660ce34efc4e6227373bb87ef83b09383a779b67eabf1dbd5f6fb138d338dc"}
Jul 23 12:18:41.414021 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:41.413960    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hqhmd"
Jul 23 12:18:41.498212 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:41.498175    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl9ff\" (UniqueName: \"kubernetes.io/projected/fd55139e-9b51-4d1d-95a3-f489e6335847-kube-api-access-gl9ff\") pod \"fd55139e-9b51-4d1d-95a3-f489e6335847\" (UID: \"fd55139e-9b51-4d1d-95a3-f489e6335847\") "
Jul 23 12:18:41.500292 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:41.500259    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd55139e-9b51-4d1d-95a3-f489e6335847-kube-api-access-gl9ff" (OuterVolumeSpecName: "kube-api-access-gl9ff") pod "fd55139e-9b51-4d1d-95a3-f489e6335847" (UID: "fd55139e-9b51-4d1d-95a3-f489e6335847"). InnerVolumeSpecName "kube-api-access-gl9ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:18:41.598875 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:41.598832    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl9ff\" (UniqueName: \"kubernetes.io/projected/fd55139e-9b51-4d1d-95a3-f489e6335847-kube-api-access-gl9ff\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:18:42.392379 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:42.392348    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hqhmd"
Jul 23 12:18:42.392379 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:42.392375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hqhmd" event={"ID":"fd55139e-9b51-4d1d-95a3-f489e6335847","Type":"ContainerDied","Data":"22e836d4c0808b7c6aeefab9bb20dd43005e4abe1977e4f3ba6b125feaa1d7a4"}
Jul 23 12:18:42.392922 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:42.392416    2570 scope.go:117] "RemoveContainer" containerID="2e660ce34efc4e6227373bb87ef83b09383a779b67eabf1dbd5f6fb138d338dc"
Jul 23 12:18:42.420529 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:42.420497    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hqhmd"]
Jul 23 12:18:42.422305 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:42.422287    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hqhmd"]
Jul 23 12:18:42.737674 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:42.737643    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd55139e-9b51-4d1d-95a3-f489e6335847" path="/var/lib/kubelet/pods/fd55139e-9b51-4d1d-95a3-f489e6335847/volumes"
Jul 23 12:18:46.011448 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:46.011419    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:46.111187 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:46.111140    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:46.168189 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:46.168142    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:49.250043 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:49.249994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:18:49.350409 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:18:49.350369    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:23.388773 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:23.388738    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:23.483343 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:23.483306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:24.032727 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.032691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:24.190598 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.190558    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:24.655176 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.655141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:24.760704 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.760666    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:24.838963 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.838928    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"]
Jul 23 12:19:24.839281 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.839269    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd55139e-9b51-4d1d-95a3-f489e6335847" containerName="authorino"
Jul 23 12:19:24.839335 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.839283    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd55139e-9b51-4d1d-95a3-f489e6335847" containerName="authorino"
Jul 23 12:19:24.839335 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.839297    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11bf7b78-f461-4405-a811-0d22a246489b" containerName="authorino"
Jul 23 12:19:24.839335 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.839304    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="11bf7b78-f461-4405-a811-0d22a246489b" containerName="authorino"
Jul 23 12:19:24.839441 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.839358    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="11bf7b78-f461-4405-a811-0d22a246489b" containerName="authorino"
Jul 23 12:19:24.839441 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.839366    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd55139e-9b51-4d1d-95a3-f489e6335847" containerName="authorino"
Jul 23 12:19:24.842242 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.842225    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:24.844589 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.844560    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 12:19:24.844589 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.844574    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hxjhx\""
Jul 23 12:19:24.852005 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.851978    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"]
Jul 23 12:19:24.879601 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.879564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stm2j\" (UniqueName: \"kubernetes.io/projected/35b30179-caec-428c-b4a9-0df94aefe918-kube-api-access-stm2j\") pod \"payload-pre-processing-7677b774bb-wcnbm\" (UID: \"35b30179-caec-428c-b4a9-0df94aefe918\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:24.879779 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.879611    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35b30179-caec-428c-b4a9-0df94aefe918-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-wcnbm\" (UID: \"35b30179-caec-428c-b4a9-0df94aefe918\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:24.980732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.980699    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stm2j\" (UniqueName: \"kubernetes.io/projected/35b30179-caec-428c-b4a9-0df94aefe918-kube-api-access-stm2j\") pod \"payload-pre-processing-7677b774bb-wcnbm\" (UID: \"35b30179-caec-428c-b4a9-0df94aefe918\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:24.980913 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.980745    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35b30179-caec-428c-b4a9-0df94aefe918-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-wcnbm\" (UID: \"35b30179-caec-428c-b4a9-0df94aefe918\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:24.981418 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.981399    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35b30179-caec-428c-b4a9-0df94aefe918-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-wcnbm\" (UID: \"35b30179-caec-428c-b4a9-0df94aefe918\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:24.988868 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:24.988843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stm2j\" (UniqueName: \"kubernetes.io/projected/35b30179-caec-428c-b4a9-0df94aefe918-kube-api-access-stm2j\") pod \"payload-pre-processing-7677b774bb-wcnbm\" (UID: \"35b30179-caec-428c-b4a9-0df94aefe918\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:25.153037 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:25.152994    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:25.289897 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:25.289870    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"]
Jul 23 12:19:25.291953 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:19:25.291924    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b30179_caec_428c_b4a9_0df94aefe918.slice/crio-5e6746f38dd43ba53e8eca7e672fa3c726ff08bf1406be459cf19153f49746b9 WatchSource:0}: Error finding container 5e6746f38dd43ba53e8eca7e672fa3c726ff08bf1406be459cf19153f49746b9: Status 404 returned error can't find the container with id 5e6746f38dd43ba53e8eca7e672fa3c726ff08bf1406be459cf19153f49746b9
Jul 23 12:19:25.609783 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:25.609693    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm" event={"ID":"35b30179-caec-428c-b4a9-0df94aefe918","Type":"ContainerStarted","Data":"5e6746f38dd43ba53e8eca7e672fa3c726ff08bf1406be459cf19153f49746b9"}
Jul 23 12:19:27.621843 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:27.621803    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm" event={"ID":"35b30179-caec-428c-b4a9-0df94aefe918","Type":"ContainerStarted","Data":"da1b01d304ea2b43ed9154ea6a93d5e9a11d5aac961d6d8b7a75a252b9b98b39"}
Jul 23 12:19:27.622229 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:27.621892    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:27.640035 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:27.639974    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm" podStartSLOduration=1.909347242 podStartE2EDuration="3.639958226s" totalImagesPullingTime="1.730610984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:19:27.638633881 +0000 UTC m=+569.399753231" watchObservedRunningTime="2026-07-23 12:19:27.639958226 +0000 UTC m=+569.401077577"
Jul 23 12:19:34.413950 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:34.413907    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:34.507169 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:34.507134    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:38.629686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:38.629654    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-wcnbm"
Jul 23 12:19:40.711495 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.711431    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"]
Jul 23 12:19:40.714963 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.714944    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.717438 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.717417    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 12:19:40.718135 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.718121    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 12:19:40.718195 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.718146    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4n8m9\""
Jul 23 12:19:40.718195 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.718160    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 12:19:40.723981 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.723959    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"]
Jul 23 12:19:40.728336 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.728310    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:40.826702 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.826659    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.826702 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.826703    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.826929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.826737    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.826929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.826818    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpcj6\" (UniqueName: \"kubernetes.io/projected/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-kube-api-access-mpcj6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.826929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.826889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.827032 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.826943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.927891 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.927852    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.928097 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.927905    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.928097 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.927924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.928222 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.928114    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.928222 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.928139    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.928222 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.928173    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpcj6\" (UniqueName: \"kubernetes.io/projected/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-kube-api-access-mpcj6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.928381 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.928317    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.928439 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.928420    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.928517 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.928460    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.930284 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.930257    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.930577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.930561    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:40.938860 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:40.938838    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpcj6\" (UniqueName: \"kubernetes.io/projected/4fcbe907-5ede-401e-a14f-b929b1cc3d7c-kube-api-access-mpcj6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk\" (UID: \"4fcbe907-5ede-401e-a14f-b929b1cc3d7c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:41.025664 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:41.025625    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:41.168111 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:41.168078    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"]
Jul 23 12:19:41.169450 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:19:41.169423    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fcbe907_5ede_401e_a14f_b929b1cc3d7c.slice/crio-3d5f4432c75bc9cccb5cf0137555b837a6be536be06324da7a67449f4f2ff54b WatchSource:0}: Error finding container 3d5f4432c75bc9cccb5cf0137555b837a6be536be06324da7a67449f4f2ff54b: Status 404 returned error can't find the container with id 3d5f4432c75bc9cccb5cf0137555b837a6be536be06324da7a67449f4f2ff54b
Jul 23 12:19:41.698384 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:41.698294    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk" event={"ID":"4fcbe907-5ede-401e-a14f-b929b1cc3d7c","Type":"ContainerStarted","Data":"3d5f4432c75bc9cccb5cf0137555b837a6be536be06324da7a67449f4f2ff54b"}
Jul 23 12:19:42.704899 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:42.704811    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk" event={"ID":"4fcbe907-5ede-401e-a14f-b929b1cc3d7c","Type":"ContainerStarted","Data":"452868e7eb3800d1f3a28732e83e193197bc71dcc44a6a3b978d7c29889fa9c2"}
Jul 23 12:19:42.724211 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:42.724137    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk" podStartSLOduration=1.585042905 podStartE2EDuration="2.724114513s" totalImagesPullingTime="1.139071608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:19:42.723418906 +0000 UTC m=+584.484538270" watchObservedRunningTime="2026-07-23 12:19:42.724114513 +0000 UTC m=+584.485233865"
Jul 23 12:19:51.026257 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:51.026217    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:51.026771 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:51.026274    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:51.038870 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:51.038833    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:51.763946 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:51.763909    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk"
Jul 23 12:19:51.995100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:51.995064    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:19:58.619908 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:58.619876    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:19:58.626899 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:19:58.626864    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:20:09.136061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:20:09.136020    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:20:18.655718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:20:18.655675    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:20:24.960536 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:20:24.960438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:20:25.065097 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:20:25.065053    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:20:37.512942 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:20:37.512900    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:20:37.621646 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:20:37.621607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:20:41.200120 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:20:41.200066    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:21:01.211954 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.211874    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"]
Jul 23 12:21:01.217339 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.217252    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.220695 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.220624    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 12:21:01.226115 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.226083    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"]
Jul 23 12:21:01.256801 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.256768    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.256995 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.256818    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f58388c4-a607-43bf-bad0-766a6ac251c9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.256995 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.256858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6gkm\" (UniqueName: \"kubernetes.io/projected/f58388c4-a607-43bf-bad0-766a6ac251c9-kube-api-access-q6gkm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.256995 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.256910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.256995 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.256937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.256995 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.256968    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.328686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.328654    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:21:01.357929 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.357896    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6gkm\" (UniqueName: \"kubernetes.io/projected/f58388c4-a607-43bf-bad0-766a6ac251c9-kube-api-access-q6gkm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.358052 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.357948    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.358096 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.358063    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.358147 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.358127    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.358206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.358168    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.358260 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.358225    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f58388c4-a607-43bf-bad0-766a6ac251c9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.358317 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.358286    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.358435 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.358415    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.358534 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.358462    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.360499 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.360447    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f58388c4-a607-43bf-bad0-766a6ac251c9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.360606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.360589    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f58388c4-a607-43bf-bad0-766a6ac251c9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.367871 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.367835    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6gkm\" (UniqueName: \"kubernetes.io/projected/f58388c4-a607-43bf-bad0-766a6ac251c9-kube-api-access-q6gkm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-khnpq\" (UID: \"f58388c4-a607-43bf-bad0-766a6ac251c9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.530971 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.530931    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:01.679405 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.679361    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"]
Jul 23 12:21:01.682728 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:01.682703    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 12:21:02.127858 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:02.127820    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq" event={"ID":"f58388c4-a607-43bf-bad0-766a6ac251c9","Type":"ContainerStarted","Data":"b4bdcc0c23198ad6fc90e6fb2b322789f15ed008109512ae492ddcba0a4d4118"}
Jul 23 12:21:02.128032 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:02.127871    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq" event={"ID":"f58388c4-a607-43bf-bad0-766a6ac251c9","Type":"ContainerStarted","Data":"85ca447dcaff8e409b22ce5ede1562b7a1d7dac9b54df80b35b80d2fbb9df063"}
Jul 23 12:21:02.150154 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:02.150095    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq" podStartSLOduration=0.9192458 podStartE2EDuration="1.15007875s" totalImagesPullingTime="230.83295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:21:02.148263985 +0000 UTC m=+663.909383335" watchObservedRunningTime="2026-07-23 12:21:02.15007875 +0000 UTC m=+663.911198101"
Jul 23 12:21:11.531543 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:11.531502    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:11.531543 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:11.531556    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:11.544542 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:11.544512    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:12.199226 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:12.199191    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-khnpq"
Jul 23 12:21:35.121884 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:35.121844    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:21:35.221938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:35.221899    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:21:38.826359 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:38.826318    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:21:38.927348 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:21:38.927303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:10.744546 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:10.744446    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:10.846537 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:10.846494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:20.540245 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:20.540202    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:24.265367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:24.265330    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:24.320556 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:24.320523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:27.775507 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.775454    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-584d8d7597-g75xm"]
Jul 23 12:22:27.778885 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.778865    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-584d8d7597-g75xm"
Jul 23 12:22:27.782445 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.782418    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 12:22:27.782445 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.782438    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tn957\""
Jul 23 12:22:27.782664 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.782451    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 12:22:27.782664 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.782533    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 12:22:27.788814 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.788787    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-584d8d7597-g75xm"]
Jul 23 12:22:27.848573 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.848531    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6jn9\" (UniqueName: \"kubernetes.io/projected/d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb-kube-api-access-p6jn9\") pod \"authorino-584d8d7597-g75xm\" (UID: \"d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb\") " pod="kuadrant-system/authorino-584d8d7597-g75xm"
Jul 23 12:22:27.848573 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.848583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb-tls-cert\") pod \"authorino-584d8d7597-g75xm\" (UID: \"d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb\") " pod="kuadrant-system/authorino-584d8d7597-g75xm"
Jul 23 12:22:27.950169 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.950104    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb-tls-cert\") pod \"authorino-584d8d7597-g75xm\" (UID: \"d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb\") " pod="kuadrant-system/authorino-584d8d7597-g75xm"
Jul 23 12:22:27.950510 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.950250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6jn9\" (UniqueName: \"kubernetes.io/projected/d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb-kube-api-access-p6jn9\") pod \"authorino-584d8d7597-g75xm\" (UID: \"d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb\") " pod="kuadrant-system/authorino-584d8d7597-g75xm"
Jul 23 12:22:27.952756 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.952737    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb-tls-cert\") pod \"authorino-584d8d7597-g75xm\" (UID: \"d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb\") " pod="kuadrant-system/authorino-584d8d7597-g75xm"
Jul 23 12:22:27.965706 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:27.965665    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6jn9\" (UniqueName: \"kubernetes.io/projected/d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb-kube-api-access-p6jn9\") pod \"authorino-584d8d7597-g75xm\" (UID: \"d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb\") " pod="kuadrant-system/authorino-584d8d7597-g75xm"
Jul 23 12:22:28.089420 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:28.089313    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-584d8d7597-g75xm"
Jul 23 12:22:28.214425 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:28.214387    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:28.243327 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:28.243303    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-584d8d7597-g75xm"]
Jul 23 12:22:28.245693 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:22:28.245662    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6ffbc7c_4d1b_486e_bafa_71fa9cc939fb.slice/crio-c4b1f053e89a70376423a4cfdbbc4e3a7a391ccc5eec438fb0733161657e9050 WatchSource:0}: Error finding container c4b1f053e89a70376423a4cfdbbc4e3a7a391ccc5eec438fb0733161657e9050: Status 404 returned error can't find the container with id c4b1f053e89a70376423a4cfdbbc4e3a7a391ccc5eec438fb0733161657e9050
Jul 23 12:22:28.315601 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:28.315561    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:28.593390 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:28.593354    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-584d8d7597-g75xm" event={"ID":"d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb","Type":"ContainerStarted","Data":"c4b1f053e89a70376423a4cfdbbc4e3a7a391ccc5eec438fb0733161657e9050"}
Jul 23 12:22:29.435766 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:29.435716    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:29.529031 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:29.528996    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:22:29.601549 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:29.601505    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-584d8d7597-g75xm" event={"ID":"d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb","Type":"ContainerStarted","Data":"e0b738c82327c50b8770681825b62d9e3bde7531d8d9bd1ef3e92df5349ecb82"}
Jul 23 12:22:29.638398 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:29.638335    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-584d8d7597-g75xm" podStartSLOduration=2.128168792 podStartE2EDuration="2.638317452s" totalImagesPullingTime="510.14866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:22:29.636920076 +0000 UTC m=+751.398039427" watchObservedRunningTime="2026-07-23 12:22:29.638317452 +0000 UTC m=+751.399436802"
Jul 23 12:22:50.084407 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:22:50.084365    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:23:01.237510 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:23:01.237453    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:23:10.691706 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:23:10.691670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:24:35.239367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:24:35.239323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:24:36.789650 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:24:36.789610    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:24:58.657995 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:24:58.657908    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:24:58.662374 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:24:58.662340    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:25:11.508783 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:25:11.508742    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:25:11.608449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:25:11.608401    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:25:11.734263 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:25:11.734233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:25:18.323637 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:25:18.323598    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:25:18.554201 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:25:18.554169    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:25:18.612791 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:25:18.612696    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:25:24.440194 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:25:24.440155    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:25:25.784134 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:25:25.784074    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:27:30.840043 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:27:30.840003    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:28:13.453330 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:28:13.453233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:28:13.510900 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:28:13.510858    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:29:22.328825 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:29:22.328739    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:29:58.697522 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:29:58.697496    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:29:58.698041 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:29:58.698025    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:30:08.710263 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:30:08.710224    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:30:08.814062 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:30:08.814029    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:31:54.161584 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:31:54.161549    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:32:59.404772 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.404737    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"]
Jul 23 12:32:59.408627 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.408606    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.411017 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.410993    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-70a17908-kserve-self-signed-certs\""
Jul 23 12:32:59.427076 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.427052    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"]
Jul 23 12:32:59.436988 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.436965    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:32:59.502403 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.502366    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-dshm\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.502614 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.502417    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-home\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.502614 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.502547    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47f44ffe-98ce-4f16-b938-8671b84b8652-tls-certs\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.502614 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.502598    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-model-cache\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.502780 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.502680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-tmp-dir\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.502780 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.502725    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9nbw\" (UniqueName: \"kubernetes.io/projected/47f44ffe-98ce-4f16-b938-8671b84b8652-kube-api-access-t9nbw\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.603758 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.603728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47f44ffe-98ce-4f16-b938-8671b84b8652-tls-certs\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.603943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.603783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-model-cache\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.603943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.603812    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-tmp-dir\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.603943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.603833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9nbw\" (UniqueName: \"kubernetes.io/projected/47f44ffe-98ce-4f16-b938-8671b84b8652-kube-api-access-t9nbw\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.603943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.603899    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-dshm\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.603943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.603929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-home\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.604230 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.604204    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-model-cache\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.604308 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.604244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-home\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.604308 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.604274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-tmp-dir\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.606148 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.606114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-dshm\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.606568 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.606545    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47f44ffe-98ce-4f16-b938-8671b84b8652-tls-certs\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.612663 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.612645    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9nbw\" (UniqueName: \"kubernetes.io/projected/47f44ffe-98ce-4f16-b938-8671b84b8652-kube-api-access-t9nbw\") pod \"e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") " pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.718505 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.718449    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:32:59.887145 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.887115    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"]
Jul 23 12:32:59.888358 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:32:59.888319    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47f44ffe_98ce_4f16_b938_8671b84b8652.slice/crio-9ebe41b6b0894fe2286d21d4908bd6e706a4067ea7347dbf8111ef24e73e73b4 WatchSource:0}: Error finding container 9ebe41b6b0894fe2286d21d4908bd6e706a4067ea7347dbf8111ef24e73e73b4: Status 404 returned error can't find the container with id 9ebe41b6b0894fe2286d21d4908bd6e706a4067ea7347dbf8111ef24e73e73b4
Jul 23 12:32:59.938177 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:32:59.938137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp" event={"ID":"47f44ffe-98ce-4f16-b938-8671b84b8652","Type":"ContainerStarted","Data":"9ebe41b6b0894fe2286d21d4908bd6e706a4067ea7347dbf8111ef24e73e73b4"}
Jul 23 12:33:00.945129 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:00.945094    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp" event={"ID":"47f44ffe-98ce-4f16-b938-8671b84b8652","Type":"ContainerStarted","Data":"f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51"}
Jul 23 12:33:00.965095 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:00.965047    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp" podStartSLOduration=1.965030489 podStartE2EDuration="1.965030489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:33:00.963814737 +0000 UTC m=+1382.724934089" watchObservedRunningTime="2026-07-23 12:33:00.965030489 +0000 UTC m=+1382.726149841"
Jul 23 12:33:09.719123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:09.719094    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:33:09.719464 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:09.719144    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:33:09.731505 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:09.731457    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:33:10.000602 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:10.000518    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:33:13.998013 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:13.997977    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"]
Jul 23 12:33:14.001542 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.001523    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.004500 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.004481    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-70a17908-kserve-self-signed-certs\""
Jul 23 12:33:14.014800 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.014777    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"]
Jul 23 12:33:14.034171 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.034139    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-dshm\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.034281 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.034173    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-tmp-dir\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.034281 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.034212    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddkpv\" (UniqueName: \"kubernetes.io/projected/28248df6-5395-4489-a9cd-8ceda991c201-kube-api-access-ddkpv\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.034281 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.034231    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-home\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.034281 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.034252    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-model-cache\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.034460 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.034286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28248df6-5395-4489-a9cd-8ceda991c201-tls-certs\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.034843 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.034823    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:33:14.135693 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.135669    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-dshm\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.135830 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.135701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-tmp-dir\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.135830 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.135734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddkpv\" (UniqueName: \"kubernetes.io/projected/28248df6-5395-4489-a9cd-8ceda991c201-kube-api-access-ddkpv\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.135830 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.135759    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-home\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.135830 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.135781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-model-cache\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.135830 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.135816    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28248df6-5395-4489-a9cd-8ceda991c201-tls-certs\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.136145 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.136118    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-home\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.136244 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.136196    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-tmp-dir\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.136244 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.136218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-model-cache\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.138022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.137998    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-dshm\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.138189 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.138171    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28248df6-5395-4489-a9cd-8ceda991c201-tls-certs\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.144795 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.144774    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddkpv\" (UniqueName: \"kubernetes.io/projected/28248df6-5395-4489-a9cd-8ceda991c201-kube-api-access-ddkpv\") pod \"e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") " pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.312315 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.312226    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:14.445814 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:14.445787    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"]
Jul 23 12:33:14.447051 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:33:14.447013    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28248df6_5395_4489_a9cd_8ceda991c201.slice/crio-92a9180a3355aec75cf894b754c95098b7e800282a5435fd139755f857a30b0c WatchSource:0}: Error finding container 92a9180a3355aec75cf894b754c95098b7e800282a5435fd139755f857a30b0c: Status 404 returned error can't find the container with id 92a9180a3355aec75cf894b754c95098b7e800282a5435fd139755f857a30b0c
Jul 23 12:33:15.017009 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:15.016974    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv" event={"ID":"28248df6-5395-4489-a9cd-8ceda991c201","Type":"ContainerStarted","Data":"97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58"}
Jul 23 12:33:15.017009 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:15.017014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv" event={"ID":"28248df6-5395-4489-a9cd-8ceda991c201","Type":"ContainerStarted","Data":"92a9180a3355aec75cf894b754c95098b7e800282a5435fd139755f857a30b0c"}
Jul 23 12:33:15.037951 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:15.037908    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv" podStartSLOduration=2.037894343 podStartE2EDuration="2.037894343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:33:15.035533183 +0000 UTC m=+1396.796652536" watchObservedRunningTime="2026-07-23 12:33:15.037894343 +0000 UTC m=+1396.799013695"
Jul 23 12:33:24.312625 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:24.312591    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:24.312996 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:24.312915    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:24.324818 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:24.324795    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:25.078659 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:25.078630    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:33:53.247313 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:53.247228    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"]
Jul 23 12:33:53.258373 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:53.258342    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:33:54.860804 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:54.860772    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"]
Jul 23 12:33:54.875647 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:33:54.875615    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:34:08.267924 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.267875    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp" podUID="47f44ffe-98ce-4f16-b938-8671b84b8652" containerName="main" containerID="cri-o://f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51" gracePeriod=45
Jul 23 12:34:08.527324 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.527271    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:34:08.596377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596343    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-dshm\") pod \"47f44ffe-98ce-4f16-b938-8671b84b8652\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") "
Jul 23 12:34:08.596377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596383    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9nbw\" (UniqueName: \"kubernetes.io/projected/47f44ffe-98ce-4f16-b938-8671b84b8652-kube-api-access-t9nbw\") pod \"47f44ffe-98ce-4f16-b938-8671b84b8652\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") "
Jul 23 12:34:08.596649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596406    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47f44ffe-98ce-4f16-b938-8671b84b8652-tls-certs\") pod \"47f44ffe-98ce-4f16-b938-8671b84b8652\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") "
Jul 23 12:34:08.596649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596427    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-model-cache\") pod \"47f44ffe-98ce-4f16-b938-8671b84b8652\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") "
Jul 23 12:34:08.596649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596502    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-tmp-dir\") pod \"47f44ffe-98ce-4f16-b938-8671b84b8652\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") "
Jul 23 12:34:08.596649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596542    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-home\") pod \"47f44ffe-98ce-4f16-b938-8671b84b8652\" (UID: \"47f44ffe-98ce-4f16-b938-8671b84b8652\") "
Jul 23 12:34:08.596858 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596730    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-model-cache" (OuterVolumeSpecName: "model-cache") pod "47f44ffe-98ce-4f16-b938-8671b84b8652" (UID: "47f44ffe-98ce-4f16-b938-8671b84b8652"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:34:08.596858 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596774    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "47f44ffe-98ce-4f16-b938-8671b84b8652" (UID: "47f44ffe-98ce-4f16-b938-8671b84b8652"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:34:08.596957 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596861    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:08.596957 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.596860    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-home" (OuterVolumeSpecName: "home") pod "47f44ffe-98ce-4f16-b938-8671b84b8652" (UID: "47f44ffe-98ce-4f16-b938-8671b84b8652"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:34:08.598708 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.598676    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-dshm" (OuterVolumeSpecName: "dshm") pod "47f44ffe-98ce-4f16-b938-8671b84b8652" (UID: "47f44ffe-98ce-4f16-b938-8671b84b8652"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:34:08.598827 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.598744    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f44ffe-98ce-4f16-b938-8671b84b8652-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "47f44ffe-98ce-4f16-b938-8671b84b8652" (UID: "47f44ffe-98ce-4f16-b938-8671b84b8652"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:34:08.598827 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.598766    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f44ffe-98ce-4f16-b938-8671b84b8652-kube-api-access-t9nbw" (OuterVolumeSpecName: "kube-api-access-t9nbw") pod "47f44ffe-98ce-4f16-b938-8671b84b8652" (UID: "47f44ffe-98ce-4f16-b938-8671b84b8652"). InnerVolumeSpecName "kube-api-access-t9nbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:34:08.697725 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.697693    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:08.697725 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.697720    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9nbw\" (UniqueName: \"kubernetes.io/projected/47f44ffe-98ce-4f16-b938-8671b84b8652-kube-api-access-t9nbw\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:08.697725 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.697730    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47f44ffe-98ce-4f16-b938-8671b84b8652-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:08.697955 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.697739    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:08.697955 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:08.697748    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47f44ffe-98ce-4f16-b938-8671b84b8652-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:09.307091 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.307055    2570 generic.go:356] "Generic (PLEG): container finished" podID="47f44ffe-98ce-4f16-b938-8671b84b8652" containerID="f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51" exitCode=0
Jul 23 12:34:09.307600 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.307101    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"
Jul 23 12:34:09.307600 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.307138    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp" event={"ID":"47f44ffe-98ce-4f16-b938-8671b84b8652","Type":"ContainerDied","Data":"f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51"}
Jul 23 12:34:09.307600 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.307180    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp" event={"ID":"47f44ffe-98ce-4f16-b938-8671b84b8652","Type":"ContainerDied","Data":"9ebe41b6b0894fe2286d21d4908bd6e706a4067ea7347dbf8111ef24e73e73b4"}
Jul 23 12:34:09.307600 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.307197    2570 scope.go:117] "RemoveContainer" containerID="f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51"
Jul 23 12:34:09.315953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.315935    2570 scope.go:117] "RemoveContainer" containerID="f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51"
Jul 23 12:34:09.316199 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:34:09.316180    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51\": container with ID starting with f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51 not found: ID does not exist" containerID="f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51"
Jul 23 12:34:09.316248 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.316206    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51"} err="failed to get container status \"f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51\": rpc error: code = NotFound desc = could not find container \"f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51\": container with ID starting with f335b26ff2aa4843b4a4289302999fc7dd88bf42be747b1c960ebfe3a4b6ee51 not found: ID does not exist"
Jul 23 12:34:09.332423 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.332398    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"]
Jul 23 12:34:09.334505 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.334486    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-70a17908-kserve-7d5df88d9f-kn4hp"]
Jul 23 12:34:09.880990 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:09.880935    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv" podUID="28248df6-5395-4489-a9cd-8ceda991c201" containerName="main" containerID="cri-o://97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58" gracePeriod=45
Jul 23 12:34:10.122234 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.122208    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:34:10.212008 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.211911    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-dshm\") pod \"28248df6-5395-4489-a9cd-8ceda991c201\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") "
Jul 23 12:34:10.212008 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.211969    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddkpv\" (UniqueName: \"kubernetes.io/projected/28248df6-5395-4489-a9cd-8ceda991c201-kube-api-access-ddkpv\") pod \"28248df6-5395-4489-a9cd-8ceda991c201\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") "
Jul 23 12:34:10.212252 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.212012    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28248df6-5395-4489-a9cd-8ceda991c201-tls-certs\") pod \"28248df6-5395-4489-a9cd-8ceda991c201\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") "
Jul 23 12:34:10.212252 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.212045    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-home\") pod \"28248df6-5395-4489-a9cd-8ceda991c201\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") "
Jul 23 12:34:10.212252 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.212079    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-tmp-dir\") pod \"28248df6-5395-4489-a9cd-8ceda991c201\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") "
Jul 23 12:34:10.212252 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.212104    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-model-cache\") pod \"28248df6-5395-4489-a9cd-8ceda991c201\" (UID: \"28248df6-5395-4489-a9cd-8ceda991c201\") "
Jul 23 12:34:10.212492 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.212344    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28248df6-5395-4489-a9cd-8ceda991c201" (UID: "28248df6-5395-4489-a9cd-8ceda991c201"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:34:10.212492 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.212360    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-home" (OuterVolumeSpecName: "home") pod "28248df6-5395-4489-a9cd-8ceda991c201" (UID: "28248df6-5395-4489-a9cd-8ceda991c201"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:34:10.212492 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.212371    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-model-cache" (OuterVolumeSpecName: "model-cache") pod "28248df6-5395-4489-a9cd-8ceda991c201" (UID: "28248df6-5395-4489-a9cd-8ceda991c201"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:34:10.214197 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.214173    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-dshm" (OuterVolumeSpecName: "dshm") pod "28248df6-5395-4489-a9cd-8ceda991c201" (UID: "28248df6-5395-4489-a9cd-8ceda991c201"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:34:10.214197 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.214189    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28248df6-5395-4489-a9cd-8ceda991c201-kube-api-access-ddkpv" (OuterVolumeSpecName: "kube-api-access-ddkpv") pod "28248df6-5395-4489-a9cd-8ceda991c201" (UID: "28248df6-5395-4489-a9cd-8ceda991c201"). InnerVolumeSpecName "kube-api-access-ddkpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:34:10.214355 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.214207    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28248df6-5395-4489-a9cd-8ceda991c201-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28248df6-5395-4489-a9cd-8ceda991c201" (UID: "28248df6-5395-4489-a9cd-8ceda991c201"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:34:10.312869 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.312840    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:10.312869 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.312865    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:10.312869 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.312874    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:10.313331 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.312883    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddkpv\" (UniqueName: \"kubernetes.io/projected/28248df6-5395-4489-a9cd-8ceda991c201-kube-api-access-ddkpv\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:10.313331 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.312891    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28248df6-5395-4489-a9cd-8ceda991c201-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:10.313331 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.312899    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28248df6-5395-4489-a9cd-8ceda991c201-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:34:10.314629 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.314607    2570 generic.go:356] "Generic (PLEG): container finished" podID="28248df6-5395-4489-a9cd-8ceda991c201" containerID="97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58" exitCode=0
Jul 23 12:34:10.314732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.314649    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"
Jul 23 12:34:10.314732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.314635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv" event={"ID":"28248df6-5395-4489-a9cd-8ceda991c201","Type":"ContainerDied","Data":"97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58"}
Jul 23 12:34:10.314732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.314690    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv" event={"ID":"28248df6-5395-4489-a9cd-8ceda991c201","Type":"ContainerDied","Data":"92a9180a3355aec75cf894b754c95098b7e800282a5435fd139755f857a30b0c"}
Jul 23 12:34:10.314732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.314706    2570 scope.go:117] "RemoveContainer" containerID="97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58"
Jul 23 12:34:10.323620 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.323601    2570 scope.go:117] "RemoveContainer" containerID="97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58"
Jul 23 12:34:10.323873 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:34:10.323852    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58\": container with ID starting with 97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58 not found: ID does not exist" containerID="97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58"
Jul 23 12:34:10.323968 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.323878    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58"} err="failed to get container status \"97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58\": rpc error: code = NotFound desc = could not find container \"97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58\": container with ID starting with 97aea60c9a74ed52c2160847f8157c745d169daf96e495d86c6783a79db56d58 not found: ID does not exist"
Jul 23 12:34:10.337936 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.337909    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"]
Jul 23 12:34:10.343263 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.343240    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-70a17908-kserve-857dd98b55-bs7sv"]
Jul 23 12:34:10.738174 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.738140    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28248df6-5395-4489-a9cd-8ceda991c201" path="/var/lib/kubelet/pods/28248df6-5395-4489-a9cd-8ceda991c201/volumes"
Jul 23 12:34:10.738537 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:10.738524    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47f44ffe-98ce-4f16-b938-8671b84b8652" path="/var/lib/kubelet/pods/47f44ffe-98ce-4f16-b938-8671b84b8652/volumes"
Jul 23 12:34:58.731123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:58.731088    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:34:58.733035 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:34:58.733012    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:36:44.432540 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:36:44.432500    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:06.518091 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:06.518007    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:20.313560 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:20.313526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:30.237209 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:30.237175    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:33.393847 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:33.393815    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:33.505662 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:33.505623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:33.882591 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:33.882565    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:39.993586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:39.993547    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:40.094529 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.094487    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:40.275732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.275637    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:40.578968 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.578888    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"]
Jul 23 12:37:40.579279 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.579266    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28248df6-5395-4489-a9cd-8ceda991c201" containerName="main"
Jul 23 12:37:40.579322 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.579281    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="28248df6-5395-4489-a9cd-8ceda991c201" containerName="main"
Jul 23 12:37:40.579322 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.579296    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f44ffe-98ce-4f16-b938-8671b84b8652" containerName="main"
Jul 23 12:37:40.579322 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.579302    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f44ffe-98ce-4f16-b938-8671b84b8652" containerName="main"
Jul 23 12:37:40.579417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.579353    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="28248df6-5395-4489-a9cd-8ceda991c201" containerName="main"
Jul 23 12:37:40.579417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.579361    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="47f44ffe-98ce-4f16-b938-8671b84b8652" containerName="main"
Jul 23 12:37:40.582621 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.582605    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.584847 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.584822    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-543ade38-openshift-default-dockercfg-x9cff\""
Jul 23 12:37:40.603659 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.603630    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"]
Jul 23 12:37:40.609501 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.609456    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:40.612740 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.612721    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-token\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.612812 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.612757    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-podinfo\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.612812 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.612778    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-credential-socket\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.612812 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.612802    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-envoy\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.612927 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.612874    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-data\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.612927 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.612913    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istiod-ca-cert\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.612996 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.612985    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-certs\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.613036 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.613010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-socket\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.613069 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.613035    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpbd7\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-kube-api-access-qpbd7\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.713687 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.713646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-token\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.713883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.713703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-podinfo\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.713883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.713732    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-credential-socket\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.713883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.713753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-envoy\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.713883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.713790    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-data\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.713883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.713815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istiod-ca-cert\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.713883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.713855    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-certs\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.714204 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.713883    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-socket\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.714204 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.713953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpbd7\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-kube-api-access-qpbd7\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.714387 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.714196    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-data\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.714387 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.714221    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-credential-socket\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.714520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.714408    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-socket\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.714520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.714418    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-certs\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.714673 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.714654    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istiod-ca-cert\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.716736 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.716714    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-envoy\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.716835 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.716820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-podinfo\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.723610 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.723589    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-token\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.723848 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.723822    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpbd7\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-kube-api-access-qpbd7\") pod \"e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") " pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:40.841843 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.841760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:40.892688 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:40.892657    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:41.028244 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:41.028216    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"]
Jul 23 12:37:41.029824 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:37:41.029799    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde62e45_a4cb_4763_ab19_f6a7f38266d5.slice/crio-04ea0bc73c4e26cc1d33d29858e85e168080a93f675e4f08476fc6408f95f70b WatchSource:0}: Error finding container 04ea0bc73c4e26cc1d33d29858e85e168080a93f675e4f08476fc6408f95f70b: Status 404 returned error can't find the container with id 04ea0bc73c4e26cc1d33d29858e85e168080a93f675e4f08476fc6408f95f70b
Jul 23 12:37:41.032052 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:41.032018    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:37:41.032146 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:41.032093    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:37:41.032146 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:41.032132    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:37:41.403911 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:41.403872    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" event={"ID":"fde62e45-a4cb-4763-ab19-f6a7f38266d5","Type":"ContainerStarted","Data":"0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0"}
Jul 23 12:37:41.404096 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:41.403941    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" event={"ID":"fde62e45-a4cb-4763-ab19-f6a7f38266d5","Type":"ContainerStarted","Data":"04ea0bc73c4e26cc1d33d29858e85e168080a93f675e4f08476fc6408f95f70b"}
Jul 23 12:37:41.426761 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:41.426715    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" podStartSLOduration=1.4266996189999999 podStartE2EDuration="1.426699619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:37:41.425267982 +0000 UTC m=+1663.186387334" watchObservedRunningTime="2026-07-23 12:37:41.426699619 +0000 UTC m=+1663.187818969"
Jul 23 12:37:41.893247 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:41.893212    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:42.771126 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:42.771087    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:42.870270 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:42.870241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:42.897988 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:42.897965    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:43.078577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:43.078497    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:43.337839 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:43.337759    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:43.413739 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:43.413713    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:43.414715 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:43.414698    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:43.588166 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:43.588094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:43.691717 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:43.691690    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:37:58.414915 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:58.414883    2570 patch_prober.go:28] interesting pod/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 12:37:58.415329 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:58.414937    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 12:37:58.500792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:58.500767    2570 generic.go:356] "Generic (PLEG): container finished" podID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerID="0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0" exitCode=0
Jul 23 12:37:58.500925 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:58.500825    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" event={"ID":"fde62e45-a4cb-4763-ab19-f6a7f38266d5","Type":"ContainerDied","Data":"0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0"}
Jul 23 12:37:58.501187 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:58.501173    2570 scope.go:117] "RemoveContainer" containerID="0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0"
Jul 23 12:37:58.502255 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:58.502228    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:37:58.502327 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:58.502314    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:37:58.502377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:58.502349    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:37:59.508347 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:59.508309    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" event={"ID":"fde62e45-a4cb-4763-ab19-f6a7f38266d5","Type":"ContainerStarted","Data":"1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3"}
Jul 23 12:37:59.893607 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:59.893512    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:37:59.893772 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:59.893749    2570 patch_prober.go:28] interesting pod/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 12:37:59.893824 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:37:59.893803    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 12:38:00.893922 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:00.893880    2570 patch_prober.go:28] interesting pod/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 12:38:00.894314 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:00.893965    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 12:38:01.893976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:01.893941    2570 patch_prober.go:28] interesting pod/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 12:38:01.894494 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:01.894025    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 12:38:02.893806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:02.893761    2570 patch_prober.go:28] interesting pod/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 12:38:02.893992 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:02.893826    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 12:38:03.897282 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:03.897253    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:38:03.897682 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:03.897511    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:38:03.898230 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:03.898211    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:38:18.949629 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:18.949595    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:23.507124 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:23.507034    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:23.669828 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:23.669795    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"]
Jul 23 12:38:23.670092 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:23.670050    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy" containerID="cri-o://1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3" gracePeriod=30
Jul 23 12:38:23.682230 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:23.682199    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:23.942885 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:23.942802    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:24.195062 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:24.194974    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:24.296662 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:24.296628    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:24.434287 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:24.434254    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:24.773461 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:24.773427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:24.890585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:24.890551    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:27.061688 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:27.061659    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:27.180663 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:27.180634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:27.421679 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:27.421595    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:27.746618 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:27.746575    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:27.846100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:27.846059    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:38:28.925736 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.925712    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:38:28.939695 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.939630    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-podinfo\") pod \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") "
Jul 23 12:38:28.939695 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.939667    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-data\") pod \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") "
Jul 23 12:38:28.939879 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.939734    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-credential-socket\") pod \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") "
Jul 23 12:38:28.939879 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.939766    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpbd7\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-kube-api-access-qpbd7\") pod \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") "
Jul 23 12:38:28.939879 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.939792    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-token\") pod \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") "
Jul 23 12:38:28.939879 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.939816    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istiod-ca-cert\") pod \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") "
Jul 23 12:38:28.940082 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.940062    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-envoy\") pod \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") "
Jul 23 12:38:28.940140 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.940102    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-socket\") pod \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") "
Jul 23 12:38:28.940193 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.940059    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fde62e45-a4cb-4763-ab19-f6a7f38266d5" (UID: "fde62e45-a4cb-4763-ab19-f6a7f38266d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:38:28.940193 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.940140    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fde62e45-a4cb-4763-ab19-f6a7f38266d5" (UID: "fde62e45-a4cb-4763-ab19-f6a7f38266d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:38:28.940461 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.940428    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-credential-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:38:28.940461 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.940453    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istiod-ca-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:38:28.940703 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.940492    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fde62e45-a4cb-4763-ab19-f6a7f38266d5" (UID: "fde62e45-a4cb-4763-ab19-f6a7f38266d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:38:28.940703 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.940637    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "fde62e45-a4cb-4763-ab19-f6a7f38266d5" (UID: "fde62e45-a4cb-4763-ab19-f6a7f38266d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:38:28.942167 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.942137    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-kube-api-access-qpbd7" (OuterVolumeSpecName: "kube-api-access-qpbd7") pod "fde62e45-a4cb-4763-ab19-f6a7f38266d5" (UID: "fde62e45-a4cb-4763-ab19-f6a7f38266d5"). InnerVolumeSpecName "kube-api-access-qpbd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:38:28.942264 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.942173    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fde62e45-a4cb-4763-ab19-f6a7f38266d5" (UID: "fde62e45-a4cb-4763-ab19-f6a7f38266d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 12:38:28.942338 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.942300    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "fde62e45-a4cb-4763-ab19-f6a7f38266d5" (UID: "fde62e45-a4cb-4763-ab19-f6a7f38266d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:38:28.942420 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:28.942403    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fde62e45-a4cb-4763-ab19-f6a7f38266d5" (UID: "fde62e45-a4cb-4763-ab19-f6a7f38266d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:38:29.040976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.040948    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-certs\") pod \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\" (UID: \"fde62e45-a4cb-4763-ab19-f6a7f38266d5\") "
Jul 23 12:38:29.041205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.041189    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpbd7\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-kube-api-access-qpbd7\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:38:29.041276 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.041211    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-token\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:38:29.041276 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.041216    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fde62e45-a4cb-4763-ab19-f6a7f38266d5" (UID: "fde62e45-a4cb-4763-ab19-f6a7f38266d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:38:29.041276 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.041225    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-envoy\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:38:29.041276 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.041272    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:38:29.041417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.041283    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-podinfo\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:38:29.041417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.041292    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-istio-data\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:38:29.141769 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.141740    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde62e45-a4cb-4763-ab19-f6a7f38266d5-workload-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:38:29.665326 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.665292    2570 generic.go:356] "Generic (PLEG): container finished" podID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerID="1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3" exitCode=0
Jul 23 12:38:29.665556 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.665341    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"
Jul 23 12:38:29.665556 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.665343    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" event={"ID":"fde62e45-a4cb-4763-ab19-f6a7f38266d5","Type":"ContainerDied","Data":"1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3"}
Jul 23 12:38:29.665556 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.665397    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4" event={"ID":"fde62e45-a4cb-4763-ab19-f6a7f38266d5","Type":"ContainerDied","Data":"04ea0bc73c4e26cc1d33d29858e85e168080a93f675e4f08476fc6408f95f70b"}
Jul 23 12:38:29.665556 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.665425    2570 scope.go:117] "RemoveContainer" containerID="1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3"
Jul 23 12:38:29.675203 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.675186    2570 scope.go:117] "RemoveContainer" containerID="0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0"
Jul 23 12:38:29.684115 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.684097    2570 scope.go:117] "RemoveContainer" containerID="1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3"
Jul 23 12:38:29.684363 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:38:29.684345    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3\": container with ID starting with 1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3 not found: ID does not exist" containerID="1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3"
Jul 23 12:38:29.684416 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.684372    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3"} err="failed to get container status \"1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3\": rpc error: code = NotFound desc = could not find container \"1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3\": container with ID starting with 1326c9e55ff19a23203a5abdee6f4a1a06068f0df29998c7ea0f5b38f6cfa3d3 not found: ID does not exist"
Jul 23 12:38:29.684416 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.684388    2570 scope.go:117] "RemoveContainer" containerID="0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0"
Jul 23 12:38:29.684686 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:38:29.684664    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0\": container with ID starting with 0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0 not found: ID does not exist" containerID="0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0"
Jul 23 12:38:29.684732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.684692    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0"} err="failed to get container status \"0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0\": rpc error: code = NotFound desc = could not find container \"0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0\": container with ID starting with 0e0555598378cff646a2de9ed55e91bf1b8ddb28a30877ab174b4403de0ea4d0 not found: ID does not exist"
Jul 23 12:38:29.689438 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.689410    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"]
Jul 23 12:38:29.694236 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:29.694213    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-543ade38-openshift-default-fc5794bfc-rrlv4"]
Jul 23 12:38:30.738370 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:38:30.738341    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" path="/var/lib/kubelet/pods/fde62e45-a4cb-4763-ab19-f6a7f38266d5/volumes"
Jul 23 12:39:02.925718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:02.925674    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:07.101878 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:07.101842    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:07.270441 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:07.270405    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:07.525566 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:07.525536    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:07.770924 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:07.770893    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:08.066239 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.066210    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"]
Jul 23 12:39:08.066623 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.066605    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy"
Jul 23 12:39:08.066623 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.066622    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy"
Jul 23 12:39:08.066787 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.066633    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy"
Jul 23 12:39:08.066787 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.066639    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy"
Jul 23 12:39:08.066787 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.066715    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy"
Jul 23 12:39:08.066787 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.066724    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde62e45-a4cb-4763-ab19-f6a7f38266d5" containerName="istio-proxy"
Jul 23 12:39:08.069982 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.069960    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.072201 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.072180    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9d7c1e5c-openshift-default-dockercfg-8bk22\""
Jul 23 12:39:08.080612 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.080589    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"]
Jul 23 12:39:08.091598 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.091579    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:08.165649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.165619    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-certs\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.166012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.165651    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-envoy\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.166012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.165693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-credential-socket\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.166012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.165717    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbf7217a-a648-4502-823d-22e42b9047d1-istio-podinfo\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.166012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.165742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-istio-token\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.166012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.165757    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbf7217a-a648-4502-823d-22e42b9047d1-istiod-ca-cert\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.166012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.165852    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-socket\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.166012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.165891    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-data\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.166012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.165922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntcxh\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-kube-api-access-ntcxh\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.266810 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.266784    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-certs\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.266938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.266822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-envoy\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.266938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.266867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-credential-socket\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.266938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.266896    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbf7217a-a648-4502-823d-22e42b9047d1-istio-podinfo\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.266938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.266929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-istio-token\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.267173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.266953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbf7217a-a648-4502-823d-22e42b9047d1-istiod-ca-cert\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.267173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.267001    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-socket\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.267173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.267034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-data\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.267173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.267065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntcxh\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-kube-api-access-ntcxh\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.267372 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.267242    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-credential-socket\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.267372 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.267351    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-socket\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.267609 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.267582    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-data\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.267787 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.267624    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-certs\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.267787 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.267711    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbf7217a-a648-4502-823d-22e42b9047d1-istiod-ca-cert\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.269552 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.269531    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-envoy\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.269663 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.269569    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbf7217a-a648-4502-823d-22e42b9047d1-istio-podinfo\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.276054 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.276036    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-istio-token\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.276483 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.276449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntcxh\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-kube-api-access-ntcxh\") pod \"e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") " pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.382605 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.382547    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:08.481435 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.481365    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:08.521046 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.521021    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"]
Jul 23 12:39:08.522673 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:39:08.522650    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf7217a_a648_4502_823d_22e42b9047d1.slice/crio-44b869503d101fda27428af4d3cd5b24836504226054ce9013346ce0ead5f6cc WatchSource:0}: Error finding container 44b869503d101fda27428af4d3cd5b24836504226054ce9013346ce0ead5f6cc: Status 404 returned error can't find the container with id 44b869503d101fda27428af4d3cd5b24836504226054ce9013346ce0ead5f6cc
Jul 23 12:39:08.524638 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.524608    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:39:08.524702 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.524678    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:39:08.524741 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.524709    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:39:08.867782 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.867749    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" event={"ID":"dbf7217a-a648-4502-823d-22e42b9047d1","Type":"ContainerStarted","Data":"355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2"}
Jul 23 12:39:08.867938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.867801    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" event={"ID":"dbf7217a-a648-4502-823d-22e42b9047d1","Type":"ContainerStarted","Data":"44b869503d101fda27428af4d3cd5b24836504226054ce9013346ce0ead5f6cc"}
Jul 23 12:39:08.888424 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:08.888379    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" podStartSLOduration=0.88836333 podStartE2EDuration="888.36333ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:39:08.886538444 +0000 UTC m=+1750.647657795" watchObservedRunningTime="2026-07-23 12:39:08.88836333 +0000 UTC m=+1750.649482682"
Jul 23 12:39:09.383153 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:09.383123    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:09.387917 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:09.387891    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:09.873062 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:09.873034    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:09.873811 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:09.873792    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:10.238119 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:10.238089    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:10.340191 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:10.340164    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:10.439815 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:10.439789    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:10.739247 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:10.739216    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:11.017527 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:11.017433    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:11.119977 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:11.119951    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:25.732930 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:25.731857    2570 patch_prober.go:28] interesting pod/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:43712->10.133.0.47:15021: read: connection reset by peer" start-of-body=
Jul 23 12:39:25.732930 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:25.731949    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:43712->10.133.0.47:15021: read: connection reset by peer"
Jul 23 12:39:25.957591 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:25.957505    2570 generic.go:356] "Generic (PLEG): container finished" podID="dbf7217a-a648-4502-823d-22e42b9047d1" containerID="355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2" exitCode=0
Jul 23 12:39:25.957591 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:25.957559    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" event={"ID":"dbf7217a-a648-4502-823d-22e42b9047d1","Type":"ContainerDied","Data":"355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2"}
Jul 23 12:39:25.957958 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:25.957943    2570 scope.go:117] "RemoveContainer" containerID="355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2"
Jul 23 12:39:25.958977 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:25.958944    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:39:25.959063 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:25.959043    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:39:25.959100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:25.959091    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:39:26.964766 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:26.964733    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" event={"ID":"dbf7217a-a648-4502-823d-22e42b9047d1","Type":"ContainerStarted","Data":"9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f"}
Jul 23 12:39:27.383125 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:27.383040    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:27.383302 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:27.383206    2570 patch_prober.go:28] interesting pod/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 23 12:39:27.383302 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:27.383261    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 23 12:39:28.383547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:28.383514    2570 patch_prober.go:28] interesting pod/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 23 12:39:28.383924 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:28.383575    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 23 12:39:29.383656 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:29.383615    2570 patch_prober.go:28] interesting pod/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 23 12:39:29.384057 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:29.383688    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 23 12:39:30.383273 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:30.383233    2570 patch_prober.go:28] interesting pod/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 23 12:39:30.383516 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:30.383292    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 23 12:39:31.386908 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:31.386879    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:31.387304 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:31.387141    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:31.387920 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:31.387901    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:46.712559 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:46.712525    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:47.563760 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:47.563725    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:51.298904 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:51.298809    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:52.553446 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:52.553417    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"]
Jul 23 12:39:52.553832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:52.553661    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy" containerID="cri-o://9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f" gracePeriod=30
Jul 23 12:39:52.574645 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:52.574620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:52.818857 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:52.818783    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:53.066281 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:53.066250    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:53.406182 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:53.406147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:53.872265 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:53.872235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:55.339922 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:55.339887    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:55.434930 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:55.434902    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:55.516582 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:55.516559    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:55.662644 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:55.662574    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:56.123997 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:56.123968    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:56.224086 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:56.224054    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:57.797701 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.797677    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:57.891507 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891425    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-certs\") pod \"dbf7217a-a648-4502-823d-22e42b9047d1\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") "
Jul 23 12:39:57.891507 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891463    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbf7217a-a648-4502-823d-22e42b9047d1-istiod-ca-cert\") pod \"dbf7217a-a648-4502-823d-22e42b9047d1\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") "
Jul 23 12:39:57.891697 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891526    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-data\") pod \"dbf7217a-a648-4502-823d-22e42b9047d1\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") "
Jul 23 12:39:57.891697 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891563    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-socket\") pod \"dbf7217a-a648-4502-823d-22e42b9047d1\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") "
Jul 23 12:39:57.891697 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891609    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-envoy\") pod \"dbf7217a-a648-4502-823d-22e42b9047d1\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") "
Jul 23 12:39:57.891697 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891641    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-istio-token\") pod \"dbf7217a-a648-4502-823d-22e42b9047d1\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") "
Jul 23 12:39:57.891697 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891690    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-credential-socket\") pod \"dbf7217a-a648-4502-823d-22e42b9047d1\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") "
Jul 23 12:39:57.891953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891709    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dbf7217a-a648-4502-823d-22e42b9047d1" (UID: "dbf7217a-a648-4502-823d-22e42b9047d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:39:57.891953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891783    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbf7217a-a648-4502-823d-22e42b9047d1-istio-podinfo\") pod \"dbf7217a-a648-4502-823d-22e42b9047d1\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") "
Jul 23 12:39:57.891953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891803    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbf7217a-a648-4502-823d-22e42b9047d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dbf7217a-a648-4502-823d-22e42b9047d1" (UID: "dbf7217a-a648-4502-823d-22e42b9047d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:39:57.891953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891828    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntcxh\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-kube-api-access-ntcxh\") pod \"dbf7217a-a648-4502-823d-22e42b9047d1\" (UID: \"dbf7217a-a648-4502-823d-22e42b9047d1\") "
Jul 23 12:39:57.891953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.891835    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dbf7217a-a648-4502-823d-22e42b9047d1" (UID: "dbf7217a-a648-4502-823d-22e42b9047d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:39:57.892198 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.892144    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:39:57.892198 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.892164    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-workload-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:39:57.892198 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.892177    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbf7217a-a648-4502-823d-22e42b9047d1-istiod-ca-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:39:57.892341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.892195    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dbf7217a-a648-4502-823d-22e42b9047d1" (UID: "dbf7217a-a648-4502-823d-22e42b9047d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:39:57.892561 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.892532    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "dbf7217a-a648-4502-823d-22e42b9047d1" (UID: "dbf7217a-a648-4502-823d-22e42b9047d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:39:57.893884 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.893852    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-kube-api-access-ntcxh" (OuterVolumeSpecName: "kube-api-access-ntcxh") pod "dbf7217a-a648-4502-823d-22e42b9047d1" (UID: "dbf7217a-a648-4502-823d-22e42b9047d1"). InnerVolumeSpecName "kube-api-access-ntcxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:39:57.893884 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.893872    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbf7217a-a648-4502-823d-22e42b9047d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dbf7217a-a648-4502-823d-22e42b9047d1" (UID: "dbf7217a-a648-4502-823d-22e42b9047d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 12:39:57.894133 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.894110    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dbf7217a-a648-4502-823d-22e42b9047d1" (UID: "dbf7217a-a648-4502-823d-22e42b9047d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:39:57.894196 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.894142    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbf7217a-a648-4502-823d-22e42b9047d1" (UID: "dbf7217a-a648-4502-823d-22e42b9047d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:39:57.993075 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.993050    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-credential-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:39:57.993075 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.993071    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbf7217a-a648-4502-823d-22e42b9047d1-istio-podinfo\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:39:57.993192 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.993082    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntcxh\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-kube-api-access-ntcxh\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:39:57.993192 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.993091    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-data\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:39:57.993192 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.993100    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbf7217a-a648-4502-823d-22e42b9047d1-istio-envoy\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:39:57.993192 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:57.993108    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbf7217a-a648-4502-823d-22e42b9047d1-istio-token\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:39:58.132568 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.132546    2570 generic.go:356] "Generic (PLEG): container finished" podID="dbf7217a-a648-4502-823d-22e42b9047d1" containerID="9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f" exitCode=0
Jul 23 12:39:58.132651 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.132598    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"
Jul 23 12:39:58.132651 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.132605    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" event={"ID":"dbf7217a-a648-4502-823d-22e42b9047d1","Type":"ContainerDied","Data":"9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f"}
Jul 23 12:39:58.132651 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.132645    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8" event={"ID":"dbf7217a-a648-4502-823d-22e42b9047d1","Type":"ContainerDied","Data":"44b869503d101fda27428af4d3cd5b24836504226054ce9013346ce0ead5f6cc"}
Jul 23 12:39:58.132799 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.132667    2570 scope.go:117] "RemoveContainer" containerID="9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f"
Jul 23 12:39:58.141448 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.141431    2570 scope.go:117] "RemoveContainer" containerID="355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2"
Jul 23 12:39:58.149597 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.149580    2570 scope.go:117] "RemoveContainer" containerID="9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f"
Jul 23 12:39:58.149828 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:39:58.149808    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f\": container with ID starting with 9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f not found: ID does not exist" containerID="9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f"
Jul 23 12:39:58.149912 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.149839    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f"} err="failed to get container status \"9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f\": rpc error: code = NotFound desc = could not find container \"9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f\": container with ID starting with 9de759c37e1de826224ac3282bd54cbd8c3d0ffe5a53d904a79f3c7d03673c5f not found: ID does not exist"
Jul 23 12:39:58.149912 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.149860    2570 scope.go:117] "RemoveContainer" containerID="355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2"
Jul 23 12:39:58.150075 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:39:58.150060    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2\": container with ID starting with 355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2 not found: ID does not exist" containerID="355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2"
Jul 23 12:39:58.150123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.150082    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2"} err="failed to get container status \"355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2\": rpc error: code = NotFound desc = could not find container \"355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2\": container with ID starting with 355ae7bbc9c9a3202ced92f59989d5fff9dd8da94c0c498299ededddbd1337c2 not found: ID does not exist"
Jul 23 12:39:58.163055 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.163033    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"]
Jul 23 12:39:58.172592 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.172572    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9d7c1e5c-openshift-default-6dd9cfb65-qrnj8"]
Jul 23 12:39:58.739903 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.739876    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" path="/var/lib/kubelet/pods/dbf7217a-a648-4502-823d-22e42b9047d1/volumes"
Jul 23 12:39:58.766113 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.766089    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:39:58.769752 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.769732    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:39:58.881918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.881896    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:39:58.982000 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:39:58.981977    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:16.952361 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:16.952326    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:17.055731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:17.055700    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:20.295232 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.295197    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"]
Jul 23 12:40:20.295619 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.295563    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy"
Jul 23 12:40:20.295619 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.295574    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy"
Jul 23 12:40:20.295619 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.295582    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy"
Jul 23 12:40:20.295619 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.295587    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy"
Jul 23 12:40:20.295752 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.295648    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy"
Jul 23 12:40:20.298696 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.298681    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"
Jul 23 12:40:20.301260 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.301237    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 12:40:20.301369 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.301324    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ncgg\""
Jul 23 12:40:20.306792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.306769    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"]
Jul 23 12:40:20.463669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.463623    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c346ddcc-cfec-4081-b2f6-7b2df00a0cfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m\" (UID: \"c346ddcc-cfec-4081-b2f6-7b2df00a0cfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"
Jul 23 12:40:20.564234 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.564142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c346ddcc-cfec-4081-b2f6-7b2df00a0cfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m\" (UID: \"c346ddcc-cfec-4081-b2f6-7b2df00a0cfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"
Jul 23 12:40:20.564877 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.564855    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c346ddcc-cfec-4081-b2f6-7b2df00a0cfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m\" (UID: \"c346ddcc-cfec-4081-b2f6-7b2df00a0cfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"
Jul 23 12:40:20.611007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.610973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"
Jul 23 12:40:20.745492 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.745454    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"]
Jul 23 12:40:20.747147 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:40:20.747117    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc346ddcc_cfec_4081_b2f6_7b2df00a0cfc.slice/crio-dcd2a702d4d9c89b0b0cd1f6c365fd7f2ff7d2baf81040993a3caee32572b229 WatchSource:0}: Error finding container dcd2a702d4d9c89b0b0cd1f6c365fd7f2ff7d2baf81040993a3caee32572b229: Status 404 returned error can't find the container with id dcd2a702d4d9c89b0b0cd1f6c365fd7f2ff7d2baf81040993a3caee32572b229
Jul 23 12:40:20.748853 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:20.748835    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 12:40:21.253240 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:21.253207    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m" event={"ID":"c346ddcc-cfec-4081-b2f6-7b2df00a0cfc","Type":"ContainerStarted","Data":"dcd2a702d4d9c89b0b0cd1f6c365fd7f2ff7d2baf81040993a3caee32572b229"}
Jul 23 12:40:23.264094 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:23.263997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m" event={"ID":"c346ddcc-cfec-4081-b2f6-7b2df00a0cfc","Type":"ContainerStarted","Data":"fe396243383ed8975f5eda8b4d3baf9980292ba03c37ec7556812f014ec113be"}
Jul 23 12:40:23.282244 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:23.282184    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m" podStartSLOduration=1.036184895 podStartE2EDuration="3.282167939s" totalImagesPullingTime="2.245983044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:40:23.280371247 +0000 UTC m=+1825.041490600" watchObservedRunningTime="2026-07-23 12:40:23.282167939 +0000 UTC m=+1825.043287309"
Jul 23 12:40:24.270662 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:24.270627    2570 generic.go:356] "Generic (PLEG): container finished" podID="c346ddcc-cfec-4081-b2f6-7b2df00a0cfc" containerID="fe396243383ed8975f5eda8b4d3baf9980292ba03c37ec7556812f014ec113be" exitCode=0
Jul 23 12:40:24.271134 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:24.270694    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m" event={"ID":"c346ddcc-cfec-4081-b2f6-7b2df00a0cfc","Type":"ContainerDied","Data":"fe396243383ed8975f5eda8b4d3baf9980292ba03c37ec7556812f014ec113be"}
Jul 23 12:40:25.406289 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:25.406264    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"
Jul 23 12:40:25.511574 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:25.511539    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c346ddcc-cfec-4081-b2f6-7b2df00a0cfc-maas-api-service-ca\") pod \"c346ddcc-cfec-4081-b2f6-7b2df00a0cfc\" (UID: \"c346ddcc-cfec-4081-b2f6-7b2df00a0cfc\") "
Jul 23 12:40:25.511910 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:25.511884    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c346ddcc-cfec-4081-b2f6-7b2df00a0cfc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c346ddcc-cfec-4081-b2f6-7b2df00a0cfc" (UID: "c346ddcc-cfec-4081-b2f6-7b2df00a0cfc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:40:25.612604 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:25.612510    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c346ddcc-cfec-4081-b2f6-7b2df00a0cfc-maas-api-service-ca\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:40:26.281297 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:26.281267    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"
Jul 23 12:40:26.281532 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:26.281268    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m" event={"ID":"c346ddcc-cfec-4081-b2f6-7b2df00a0cfc","Type":"ContainerDied","Data":"dcd2a702d4d9c89b0b0cd1f6c365fd7f2ff7d2baf81040993a3caee32572b229"}
Jul 23 12:40:26.281532 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:26.281393    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcd2a702d4d9c89b0b0cd1f6c365fd7f2ff7d2baf81040993a3caee32572b229"
Jul 23 12:40:30.854750 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:30.854715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:35.384415 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:35.384387    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:35.395161 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:35.395135    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"]
Jul 23 12:40:35.405457 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:35.405434    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3e72e548-s7d6m"]
Jul 23 12:40:35.559777 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:35.559744    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:35.812462 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:35.812431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:36.322918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:36.322876    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:36.419612 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:36.419577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:36.523546 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:36.523512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:36.737985 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:36.737953    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c346ddcc-cfec-4081-b2f6-7b2df00a0cfc" path="/var/lib/kubelet/pods/c346ddcc-cfec-4081-b2f6-7b2df00a0cfc/volumes"
Jul 23 12:40:38.007714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:38.007675    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:45.239414 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:45.239375    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:45.346267 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:45.346234    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:45.441583 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:45.441545    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:45.547201 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:45.547107    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:40:51.136633 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:40:51.136597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:17.213940 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:17.213907    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:24.348205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:24.348108    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:24.411551 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:24.411516    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:24.493490 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:24.493444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:24.592792 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:24.592761    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:40.560707 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:40.560666    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:46.584374 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:46.584335    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:46.694308 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:46.694264    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:46.785082 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:46.785029    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:57.340072 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:57.340034    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:41:58.184200 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:41:58.184170    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:05.378724 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:05.378687    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:05.503957 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:05.503923    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:05.614643 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:05.614611    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:05.726014 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:05.725978    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:06.585580 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:06.585539    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:06.683748 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:06.683717    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:06.785884 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:06.785847    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:08.535265 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:08.535221    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:15.188145 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:15.188102    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:15.289894 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:15.289853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:15.896430 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:15.896395    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:22.521870 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:22.521831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:22.618839 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:22.618791    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:22.773140 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:22.773053    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:23.080086 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.080015    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"]
Jul 23 12:42:23.080367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.080354    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c346ddcc-cfec-4081-b2f6-7b2df00a0cfc" containerName="revoke-keys"
Jul 23 12:42:23.080417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.080368    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c346ddcc-cfec-4081-b2f6-7b2df00a0cfc" containerName="revoke-keys"
Jul 23 12:42:23.080453 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.080436    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbf7217a-a648-4502-823d-22e42b9047d1" containerName="istio-proxy"
Jul 23 12:42:23.080453 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.080448    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c346ddcc-cfec-4081-b2f6-7b2df00a0cfc" containerName="revoke-keys"
Jul 23 12:42:23.083531 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.083517    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.087893 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.087873    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-312a3fbf-openshift-default-dockercfg-mq7p4\""
Jul 23 12:42:23.109380 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.109357    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"]
Jul 23 12:42:23.113183 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.113164    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:23.169083 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.169058    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-data\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.169186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.169098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-token\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.169186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.169120    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-credential-socket\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.169186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.169140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-envoy\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.169186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.169161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-socket\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.169428 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.169201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-certs\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.169428 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.169223    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6001937c-7af4-4a0b-a4b9-08d2feedae91-istiod-ca-cert\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.169428 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.169245    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llqxx\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-kube-api-access-llqxx\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.169428 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.169295    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-podinfo\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270114 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270081    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-podinfo\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270241 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270124    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-data\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270241 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-token\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270241 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270232    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-credential-socket\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270395 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270260    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-envoy\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270395 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270287    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-socket\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270395 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-certs\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270395 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6001937c-7af4-4a0b-a4b9-08d2feedae91-istiod-ca-cert\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llqxx\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-kube-api-access-llqxx\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-data\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270655    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-credential-socket\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270801 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270768    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-socket\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.270913 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.270894    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-certs\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.271316 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.271285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6001937c-7af4-4a0b-a4b9-08d2feedae91-istiod-ca-cert\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.272992 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.272963    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-envoy\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.273101 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.273085    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-podinfo\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.278892 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.278868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llqxx\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-kube-api-access-llqxx\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.279013 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.278994    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-token\") pod \"e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") " pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.301589 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.301567    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:23.393763 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.393704    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:23.532901 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.532875    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"]
Jul 23 12:42:23.534670 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:42:23.534644    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6001937c_7af4_4a0b_a4b9_08d2feedae91.slice/crio-bf5898feb13f3bea6f45a0b828d17b187e089c878f57f4eabe61f8d87c371e5f WatchSource:0}: Error finding container bf5898feb13f3bea6f45a0b828d17b187e089c878f57f4eabe61f8d87c371e5f: Status 404 returned error can't find the container with id bf5898feb13f3bea6f45a0b828d17b187e089c878f57f4eabe61f8d87c371e5f
Jul 23 12:42:23.536805 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.536774    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:42:23.536903 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.536849    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:42:23.536903 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.536894    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:42:23.901174 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.901140    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" event={"ID":"6001937c-7af4-4a0b-a4b9-08d2feedae91","Type":"ContainerStarted","Data":"39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7"}
Jul 23 12:42:23.901331 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.901198    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" event={"ID":"6001937c-7af4-4a0b-a4b9-08d2feedae91","Type":"ContainerStarted","Data":"bf5898feb13f3bea6f45a0b828d17b187e089c878f57f4eabe61f8d87c371e5f"}
Jul 23 12:42:23.924361 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:23.924300    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" podStartSLOduration=0.924279241 podStartE2EDuration="924.279241ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:42:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:42:23.923109501 +0000 UTC m=+1945.684228843" watchObservedRunningTime="2026-07-23 12:42:23.924279241 +0000 UTC m=+1945.685398653"
Jul 23 12:42:24.393853 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:24.393811    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:24.398980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:24.398951    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:24.906057 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:24.906031    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:24.906943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:24.906926    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:26.034850 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:26.034810    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:26.137647 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:26.137614    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:26.237445 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:26.237416    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:26.528695 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:26.528662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:26.842883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:26.842787    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:26.947980 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:26.947941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:30.568998 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:30.568958    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:31.280834 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:31.280804    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:31.379185 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:31.379156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:31.763100 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:31.763074    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:38.174659 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:38.174620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:38.274606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:38.274569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:39.907598 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:39.907537    2570 patch_prober.go:28] interesting pod/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 12:42:39.907937 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:39.907596    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 12:42:39.993236 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:39.993178    2570 generic.go:356] "Generic (PLEG): container finished" podID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerID="39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7" exitCode=0
Jul 23 12:42:39.993320 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:39.993247    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" event={"ID":"6001937c-7af4-4a0b-a4b9-08d2feedae91","Type":"ContainerDied","Data":"39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7"}
Jul 23 12:42:39.993645 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:39.993630    2570 scope.go:117] "RemoveContainer" containerID="39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7"
Jul 23 12:42:39.994705 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:39.994681    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:42:39.994772 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:39.994752    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:42:39.994809 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:39.994787    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:42:41.000484 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:41.000446    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" event={"ID":"6001937c-7af4-4a0b-a4b9-08d2feedae91","Type":"ContainerStarted","Data":"74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366"}
Jul 23 12:42:41.393937 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:41.393844    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:41.394081 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:41.394056    2570 patch_prober.go:28] interesting pod/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 12:42:41.394123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:41.394102    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 12:42:42.394661 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:42.394623    2570 patch_prober.go:28] interesting pod/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 12:42:42.395117 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:42.394684    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 12:42:43.394521 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:43.394481    2570 patch_prober.go:28] interesting pod/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 12:42:43.394685 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:43.394545    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 12:42:44.394630 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:44.394599    2570 patch_prober.go:28] interesting pod/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 12:42:44.394785 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:44.394663    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 12:42:45.397195 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:45.397165    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:45.397652 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:45.397566    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:45.398290 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:45.398272    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:42:48.938459 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:48.938423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:53.666898 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:53.666801    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:42:54.087082 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:42:54.087042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:00.155922 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:00.155876    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:00.256856 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:00.256809    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:00.420719 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:00.420627    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"]
Jul 23 12:43:00.420906 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:00.420881    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy" containerID="cri-o://74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366" gracePeriod=30
Jul 23 12:43:00.445125 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:00.445087    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:00.703811 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:00.703707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:00.830064 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:00.830029    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:00.918918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:00.918878    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:01.054861 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:01.054821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:05.689181 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.689089    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:43:05.855279 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855240    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-socket\") pod \"6001937c-7af4-4a0b-a4b9-08d2feedae91\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") "
Jul 23 12:43:05.855529 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855304    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llqxx\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-kube-api-access-llqxx\") pod \"6001937c-7af4-4a0b-a4b9-08d2feedae91\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") "
Jul 23 12:43:05.855529 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855366    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6001937c-7af4-4a0b-a4b9-08d2feedae91-istiod-ca-cert\") pod \"6001937c-7af4-4a0b-a4b9-08d2feedae91\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") "
Jul 23 12:43:05.855663 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855540    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-podinfo\") pod \"6001937c-7af4-4a0b-a4b9-08d2feedae91\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") "
Jul 23 12:43:05.855663 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855591    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-data\") pod \"6001937c-7af4-4a0b-a4b9-08d2feedae91\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") "
Jul 23 12:43:05.855663 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855623    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-credential-socket\") pod \"6001937c-7af4-4a0b-a4b9-08d2feedae91\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") "
Jul 23 12:43:05.855830 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855669    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-token\") pod \"6001937c-7af4-4a0b-a4b9-08d2feedae91\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") "
Jul 23 12:43:05.855830 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855589    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6001937c-7af4-4a0b-a4b9-08d2feedae91" (UID: "6001937c-7af4-4a0b-a4b9-08d2feedae91"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:43:05.855830 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855693    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-certs\") pod \"6001937c-7af4-4a0b-a4b9-08d2feedae91\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") "
Jul 23 12:43:05.855987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855839    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-envoy\") pod \"6001937c-7af4-4a0b-a4b9-08d2feedae91\" (UID: \"6001937c-7af4-4a0b-a4b9-08d2feedae91\") "
Jul 23 12:43:05.855987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855955    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6001937c-7af4-4a0b-a4b9-08d2feedae91-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6001937c-7af4-4a0b-a4b9-08d2feedae91" (UID: "6001937c-7af4-4a0b-a4b9-08d2feedae91"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:43:05.855987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.855971    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6001937c-7af4-4a0b-a4b9-08d2feedae91" (UID: "6001937c-7af4-4a0b-a4b9-08d2feedae91"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:43:05.856152 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.856060    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6001937c-7af4-4a0b-a4b9-08d2feedae91" (UID: "6001937c-7af4-4a0b-a4b9-08d2feedae91"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:43:05.856251 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.856231    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6001937c-7af4-4a0b-a4b9-08d2feedae91-istiod-ca-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:43:05.856293 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.856258    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-credential-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:43:05.856293 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.856275    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:43:05.856293 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.856288    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-workload-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:43:05.856569 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.856539    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-data" (OuterVolumeSpecName: "istio-data") pod "6001937c-7af4-4a0b-a4b9-08d2feedae91" (UID: "6001937c-7af4-4a0b-a4b9-08d2feedae91"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:43:05.857793 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.857769    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-token" (OuterVolumeSpecName: "istio-token") pod "6001937c-7af4-4a0b-a4b9-08d2feedae91" (UID: "6001937c-7af4-4a0b-a4b9-08d2feedae91"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:43:05.857901 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.857850    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-kube-api-access-llqxx" (OuterVolumeSpecName: "kube-api-access-llqxx") pod "6001937c-7af4-4a0b-a4b9-08d2feedae91" (UID: "6001937c-7af4-4a0b-a4b9-08d2feedae91"). InnerVolumeSpecName "kube-api-access-llqxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:43:05.858164 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.858142    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6001937c-7af4-4a0b-a4b9-08d2feedae91" (UID: "6001937c-7af4-4a0b-a4b9-08d2feedae91"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:43:05.858225 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.858137    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6001937c-7af4-4a0b-a4b9-08d2feedae91" (UID: "6001937c-7af4-4a0b-a4b9-08d2feedae91"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 12:43:05.957357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.957256    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-data\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:43:05.957357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.957294    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-token\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:43:05.957357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.957303    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-envoy\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:43:05.957357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.957313    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llqxx\" (UniqueName: \"kubernetes.io/projected/6001937c-7af4-4a0b-a4b9-08d2feedae91-kube-api-access-llqxx\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:43:05.957357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:05.957324    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6001937c-7af4-4a0b-a4b9-08d2feedae91-istio-podinfo\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:43:06.136734 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.136698    2570 generic.go:356] "Generic (PLEG): container finished" podID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerID="74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366" exitCode=0
Jul 23 12:43:06.136938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.136747    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"
Jul 23 12:43:06.136938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.136780    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" event={"ID":"6001937c-7af4-4a0b-a4b9-08d2feedae91","Type":"ContainerDied","Data":"74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366"}
Jul 23 12:43:06.136938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.136841    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp" event={"ID":"6001937c-7af4-4a0b-a4b9-08d2feedae91","Type":"ContainerDied","Data":"bf5898feb13f3bea6f45a0b828d17b187e089c878f57f4eabe61f8d87c371e5f"}
Jul 23 12:43:06.136938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.136869    2570 scope.go:117] "RemoveContainer" containerID="74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366"
Jul 23 12:43:06.147058 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.147028    2570 scope.go:117] "RemoveContainer" containerID="39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7"
Jul 23 12:43:06.156319 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.156295    2570 scope.go:117] "RemoveContainer" containerID="74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366"
Jul 23 12:43:06.156711 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:43:06.156690    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366\": container with ID starting with 74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366 not found: ID does not exist" containerID="74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366"
Jul 23 12:43:06.156788 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.156722    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366"} err="failed to get container status \"74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366\": rpc error: code = NotFound desc = could not find container \"74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366\": container with ID starting with 74b76dcd7d857039339d3ea6478361d1a6d9703e2ec5afa46cd20865394c6366 not found: ID does not exist"
Jul 23 12:43:06.156788 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.156743    2570 scope.go:117] "RemoveContainer" containerID="39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7"
Jul 23 12:43:06.156993 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:43:06.156977    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7\": container with ID starting with 39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7 not found: ID does not exist" containerID="39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7"
Jul 23 12:43:06.157041 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.156997    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7"} err="failed to get container status \"39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7\": rpc error: code = NotFound desc = could not find container \"39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7\": container with ID starting with 39a78b1875083b1c840d914d09aaa955d138eba0ce31175a8a152e96b10289f7 not found: ID does not exist"
Jul 23 12:43:06.163198 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.163164    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"]
Jul 23 12:43:06.167897 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.167865    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-312a3fbf-openshift-default-bc7579f95-6lhnp"]
Jul 23 12:43:06.738679 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:06.738637    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" path="/var/lib/kubelet/pods/6001937c-7af4-4a0b-a4b9-08d2feedae91/volumes"
Jul 23 12:43:07.450119 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:07.450047    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:07.553759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:07.553725    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:07.647918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:07.647887    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:07.832956 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:07.832912    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:13.911186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:13.911147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:13.966742 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:13.966707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:20.904534 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:20.904485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:21.332205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:21.332163    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:21.841845 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:21.841811    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:23.971803 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:23.971757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:24.056341 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:24.056292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:24.119096 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:24.119060    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:24.382798 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:24.382710    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:24.802427 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:24.802391    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:24.896660 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:24.896624    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:28.486759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:28.486723    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:45.101442 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.101397    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"]
Jul 23 12:43:45.101965 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.101804    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy"
Jul 23 12:43:45.101965 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.101817    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy"
Jul 23 12:43:45.101965 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.101826    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy"
Jul 23 12:43:45.101965 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.101832    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy"
Jul 23 12:43:45.101965 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.101886    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy"
Jul 23 12:43:45.105012 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.104983    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.108851 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.108817    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e67fae86\"/\"e2e-lifecycle-model-e67fae86-kserve-self-signed-certs\""
Jul 23 12:43:45.109066 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.108929    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e67fae86\"/\"kube-root-ca.crt\""
Jul 23 12:43:45.109066 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.108935    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e67fae86\"/\"default-dockercfg-tk2gf\""
Jul 23 12:43:45.109066 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.108970    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e67fae86\"/\"openshift-service-ca.crt\""
Jul 23 12:43:45.116990 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.116952    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"]
Jul 23 12:43:45.222714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.222664    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6n6z\" (UniqueName: \"kubernetes.io/projected/8283a335-1c9d-49df-bba0-a08a705807d5-kube-api-access-h6n6z\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.222714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.222717    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-dshm\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.222964 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.222775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-home\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.222964 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.222835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8283a335-1c9d-49df-bba0-a08a705807d5-tls-certs\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.223049 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.222972    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-model-cache\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.223049 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.223025    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-tmp-dir\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.228454 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.228412    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:43:45.324056 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.324013    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-model-cache\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.324253 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.324098    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-tmp-dir\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.324253 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.324136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n6z\" (UniqueName: \"kubernetes.io/projected/8283a335-1c9d-49df-bba0-a08a705807d5-kube-api-access-h6n6z\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.324253 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.324164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-dshm\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.324253 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.324198    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-home\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.324253 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.324224    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8283a335-1c9d-49df-bba0-a08a705807d5-tls-certs\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.324523 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.324440    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-model-cache\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.324641 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.324620    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-home\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.324686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.324652    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-tmp-dir\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.326714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.326686    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-dshm\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.327317 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.327296    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8283a335-1c9d-49df-bba0-a08a705807d5-tls-certs\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.334169 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.334132    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6n6z\" (UniqueName: \"kubernetes.io/projected/8283a335-1c9d-49df-bba0-a08a705807d5-kube-api-access-h6n6z\") pod \"e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") " pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.416226 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.416106    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:45.571580 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:45.571546    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"]
Jul 23 12:43:45.574080 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:43:45.574050    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8283a335_1c9d_49df_bba0_a08a705807d5.slice/crio-9aaf99cddabb48c50b0cc315abe09a635f3c2d40f805fd72ed77530eabb59173 WatchSource:0}: Error finding container 9aaf99cddabb48c50b0cc315abe09a635f3c2d40f805fd72ed77530eabb59173: Status 404 returned error can't find the container with id 9aaf99cddabb48c50b0cc315abe09a635f3c2d40f805fd72ed77530eabb59173
Jul 23 12:43:46.361381 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:46.361335    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb" event={"ID":"8283a335-1c9d-49df-bba0-a08a705807d5","Type":"ContainerStarted","Data":"53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7"}
Jul 23 12:43:46.361839 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:46.361394    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb" event={"ID":"8283a335-1c9d-49df-bba0-a08a705807d5","Type":"ContainerStarted","Data":"9aaf99cddabb48c50b0cc315abe09a635f3c2d40f805fd72ed77530eabb59173"}
Jul 23 12:43:46.381611 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:46.381536    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb" podStartSLOduration=1.381516363 podStartE2EDuration="1.381516363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:43:46.379510702 +0000 UTC m=+2028.140630050" watchObservedRunningTime="2026-07-23 12:43:46.381516363 +0000 UTC m=+2028.142635714"
Jul 23 12:43:55.416888 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:55.416833    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:55.416888 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:55.416895    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:55.429942 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:55.429908    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:43:56.427453 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:43:56.427414    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:44:22.811145 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:22.811017    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:44:27.356755 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:27.356718    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:44:29.843751 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:29.843713    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:44:34.739245 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:34.739201    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"]
Jul 23 12:44:34.786987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:34.786953    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:44:49.760873 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:49.760798    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb" podUID="8283a335-1c9d-49df-bba0-a08a705807d5" containerName="main" containerID="cri-o://53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7" gracePeriod=45
Jul 23 12:44:50.029899 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.029860    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:44:50.134573 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.134529    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8283a335-1c9d-49df-bba0-a08a705807d5-tls-certs\") pod \"8283a335-1c9d-49df-bba0-a08a705807d5\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") "
Jul 23 12:44:50.134806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.134602    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-model-cache\") pod \"8283a335-1c9d-49df-bba0-a08a705807d5\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") "
Jul 23 12:44:50.134806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.134645    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-dshm\") pod \"8283a335-1c9d-49df-bba0-a08a705807d5\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") "
Jul 23 12:44:50.134806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.134667    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-home\") pod \"8283a335-1c9d-49df-bba0-a08a705807d5\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") "
Jul 23 12:44:50.134976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.134801    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-tmp-dir\") pod \"8283a335-1c9d-49df-bba0-a08a705807d5\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") "
Jul 23 12:44:50.134976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.134866    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6n6z\" (UniqueName: \"kubernetes.io/projected/8283a335-1c9d-49df-bba0-a08a705807d5-kube-api-access-h6n6z\") pod \"8283a335-1c9d-49df-bba0-a08a705807d5\" (UID: \"8283a335-1c9d-49df-bba0-a08a705807d5\") "
Jul 23 12:44:50.134976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.134949    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-home" (OuterVolumeSpecName: "home") pod "8283a335-1c9d-49df-bba0-a08a705807d5" (UID: "8283a335-1c9d-49df-bba0-a08a705807d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:44:50.134976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.134963    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "8283a335-1c9d-49df-bba0-a08a705807d5" (UID: "8283a335-1c9d-49df-bba0-a08a705807d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:44:50.135172 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.135104    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8283a335-1c9d-49df-bba0-a08a705807d5" (UID: "8283a335-1c9d-49df-bba0-a08a705807d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:44:50.135260 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.135243    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:44:50.135299 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.135267    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:44:50.135299 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.135281    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:44:50.137151 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.137115    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8283a335-1c9d-49df-bba0-a08a705807d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8283a335-1c9d-49df-bba0-a08a705807d5" (UID: "8283a335-1c9d-49df-bba0-a08a705807d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:44:50.137151 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.137116    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8283a335-1c9d-49df-bba0-a08a705807d5-kube-api-access-h6n6z" (OuterVolumeSpecName: "kube-api-access-h6n6z") pod "8283a335-1c9d-49df-bba0-a08a705807d5" (UID: "8283a335-1c9d-49df-bba0-a08a705807d5"). InnerVolumeSpecName "kube-api-access-h6n6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:44:50.137317 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.137124    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-dshm" (OuterVolumeSpecName: "dshm") pod "8283a335-1c9d-49df-bba0-a08a705807d5" (UID: "8283a335-1c9d-49df-bba0-a08a705807d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:44:50.236759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.236709    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8283a335-1c9d-49df-bba0-a08a705807d5-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:44:50.236759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.236747    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6n6z\" (UniqueName: \"kubernetes.io/projected/8283a335-1c9d-49df-bba0-a08a705807d5-kube-api-access-h6n6z\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:44:50.236759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.236758    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8283a335-1c9d-49df-bba0-a08a705807d5-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:44:50.726375 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.726339    2570 generic.go:356] "Generic (PLEG): container finished" podID="8283a335-1c9d-49df-bba0-a08a705807d5" containerID="53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7" exitCode=0
Jul 23 12:44:50.726561 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.726388    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"
Jul 23 12:44:50.726561 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.726432    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb" event={"ID":"8283a335-1c9d-49df-bba0-a08a705807d5","Type":"ContainerDied","Data":"53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7"}
Jul 23 12:44:50.726561 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.726506    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb" event={"ID":"8283a335-1c9d-49df-bba0-a08a705807d5","Type":"ContainerDied","Data":"9aaf99cddabb48c50b0cc315abe09a635f3c2d40f805fd72ed77530eabb59173"}
Jul 23 12:44:50.726561 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.726527    2570 scope.go:117] "RemoveContainer" containerID="53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7"
Jul 23 12:44:50.741402 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.741360    2570 scope.go:117] "RemoveContainer" containerID="53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7"
Jul 23 12:44:50.742928 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:44:50.742883    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7\": container with ID starting with 53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7 not found: ID does not exist" containerID="53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7"
Jul 23 12:44:50.743143 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.742947    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7"} err="failed to get container status \"53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7\": rpc error: code = NotFound desc = could not find container \"53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7\": container with ID starting with 53c211268b8363588fbc5669debc13d28fc21ba8f72091c1dba2eba4355af4e7 not found: ID does not exist"
Jul 23 12:44:50.755050 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.754771    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"]
Jul 23 12:44:50.757549 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:50.757506    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e67fae86/e2e-lifecycle-model-e67fae86-kserve-647559c4c-kwtfb"]
Jul 23 12:44:52.738811 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:52.738766    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8283a335-1c9d-49df-bba0-a08a705807d5" path="/var/lib/kubelet/pods/8283a335-1c9d-49df-bba0-a08a705807d5/volumes"
Jul 23 12:44:53.499729 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:53.499679    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:44:53.600308 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:53.600265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:44:58.804760 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:58.804731    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:44:58.808356 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:58.808333    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:44:59.790361 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:59.790323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:44:59.892131 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:44:59.892093    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:00.143259 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.143173    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h"]
Jul 23 12:45:00.143578 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.143562    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8283a335-1c9d-49df-bba0-a08a705807d5" containerName="main"
Jul 23 12:45:00.143628 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.143579    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8283a335-1c9d-49df-bba0-a08a705807d5" containerName="main"
Jul 23 12:45:00.143670 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.143635    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6001937c-7af4-4a0b-a4b9-08d2feedae91" containerName="istio-proxy"
Jul 23 12:45:00.143670 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.143646    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8283a335-1c9d-49df-bba0-a08a705807d5" containerName="main"
Jul 23 12:45:00.147910 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.147890    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h"
Jul 23 12:45:00.150649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.150618    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ncgg\""
Jul 23 12:45:00.151832 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.151768    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h"]
Jul 23 12:45:00.159939 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.159918    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h"
Jul 23 12:45:00.300761 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.300736    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h"]
Jul 23 12:45:00.302698 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:45:00.302669    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fc275b_8601_405c_afda_86964db5c4e5.slice/crio-2217616b04f652a8f0aef88693703afdd2812e47eee63a8076dcde647644ddb1 WatchSource:0}: Error finding container 2217616b04f652a8f0aef88693703afdd2812e47eee63a8076dcde647644ddb1: Status 404 returned error can't find the container with id 2217616b04f652a8f0aef88693703afdd2812e47eee63a8076dcde647644ddb1
Jul 23 12:45:00.783840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.783805    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h" event={"ID":"81fc275b-8601-405c-afda-86964db5c4e5","Type":"ContainerStarted","Data":"1e58752acece284eedc638f8064273473d941662354f878d62ea6a5ea60281a2"}
Jul 23 12:45:00.784043 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.783869    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h" event={"ID":"81fc275b-8601-405c-afda-86964db5c4e5","Type":"ContainerStarted","Data":"2217616b04f652a8f0aef88693703afdd2812e47eee63a8076dcde647644ddb1"}
Jul 23 12:45:00.804004 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:00.803903    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h" podStartSLOduration=0.803886743 podStartE2EDuration="803.886743ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:45:00.802001952 +0000 UTC m=+2102.563121318" watchObservedRunningTime="2026-07-23 12:45:00.803886743 +0000 UTC m=+2102.565006095"
Jul 23 12:45:01.795434 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:01.795389    2570 generic.go:356] "Generic (PLEG): container finished" podID="81fc275b-8601-405c-afda-86964db5c4e5" containerID="1e58752acece284eedc638f8064273473d941662354f878d62ea6a5ea60281a2" exitCode=0
Jul 23 12:45:01.795948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:01.795493    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h" event={"ID":"81fc275b-8601-405c-afda-86964db5c4e5","Type":"ContainerDied","Data":"1e58752acece284eedc638f8064273473d941662354f878d62ea6a5ea60281a2"}
Jul 23 12:45:02.937086 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:02.937059    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h"
Jul 23 12:45:03.807141 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:03.807107    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h"
Jul 23 12:45:03.807141 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:03.807117    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746845-lmj2h" event={"ID":"81fc275b-8601-405c-afda-86964db5c4e5","Type":"ContainerDied","Data":"2217616b04f652a8f0aef88693703afdd2812e47eee63a8076dcde647644ddb1"}
Jul 23 12:45:03.807371 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:03.807173    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2217616b04f652a8f0aef88693703afdd2812e47eee63a8076dcde647644ddb1"
Jul 23 12:45:11.093855 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:11.093811    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:12.588873 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:12.588832    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:18.369857 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:18.369824    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:18.425563 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:18.425532    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:18.669649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:18.669569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:18.901247 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:18.901213    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:19.851917 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:19.851886    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:20.017037 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:20.016999    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:20.120984 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:20.120890    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:20.217791 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:20.217752    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:21.060208 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:21.060172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:21.149539 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:21.149464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:21.245384 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:21.245344    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:22.710547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:22.710511    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:22.810452 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:22.810417    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:22.910762 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:22.910721    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:28.336971 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:28.336941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:28.937145 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:28.937101    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:28.990281 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:28.990243    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:29.456007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:29.455971    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:29.696518 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:29.696455    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:36.145545 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:36.145511    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:36.221416 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:36.221379    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:36.304723 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:36.304686    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:36.399698 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:36.399602    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:46.957058 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:46.957007    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:45:47.312749 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:45:47.312711    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:08.752829 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:08.752722    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:15.023447 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:15.023413    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:15.081460 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:15.081428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:15.376061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:15.375966    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:16.126362 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:16.126323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:16.227706 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:16.227672    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:18.832451 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:18.832411    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:18.919501 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:18.919447    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:18.986375 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:18.986342    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:19.142264 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:19.142152    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:19.519077 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:19.519042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:19.619642 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:19.619605    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:23.376547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:23.376515    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:23.728319 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:23.728284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:24.029355 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.029261    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"]
Jul 23 12:46:24.029645 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.029631    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fc275b-8601-405c-afda-86964db5c4e5" containerName="cleanup"
Jul 23 12:46:24.029703 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.029647    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fc275b-8601-405c-afda-86964db5c4e5" containerName="cleanup"
Jul 23 12:46:24.029746 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.029736    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="81fc275b-8601-405c-afda-86964db5c4e5" containerName="cleanup"
Jul 23 12:46:24.032954 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.032929    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.035504 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.035439    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4551ad-openshift-default-dockercfg-qqp7s\""
Jul 23 12:46:24.046095 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.046060    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"]
Jul 23 12:46:24.056363 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.056327    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:24.097493 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.097416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q67j7\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-kube-api-access-q67j7\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.097691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.097516    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-certs\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.097691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.097540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-credential-socket\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.097691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.097559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-envoy\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.097691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.097661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-podinfo\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.097691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.097689    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-token\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.097883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.097707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-socket\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.097883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.097732    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-data\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.097883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.097754    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istiod-ca-cert\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.198499 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.198421    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istiod-ca-cert\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.198699 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.198538    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q67j7\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-kube-api-access-q67j7\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.198699 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.198572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-certs\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.198699 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.198610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-credential-socket\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.198699 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.198627    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-envoy\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.198699 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.198665    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-podinfo\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.198699 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.198687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-token\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.199045 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.198710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-socket\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.199045 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.198730    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-data\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.199172 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.199071    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-credential-socket\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.199259 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.199234    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-certs\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.199315 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.199253    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istiod-ca-cert\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.199315 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.199274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-data\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.199315 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.199294    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-socket\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.200393 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.200353    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:24.201422 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.201388    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-envoy\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.201591 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.201568    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-podinfo\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.207885 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.207851    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-token\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.208007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.207925    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q67j7\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-kube-api-access-q67j7\") pod \"e2e-inf-b-4551ad-openshift-default-756485847f-2slkt\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") " pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.344523 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.344373    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:24.506390 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.506356    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"]
Jul 23 12:46:24.508291 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:46:24.508252    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5bb8b5a_bfbe_4720_b06d_18d28d0a0d00.slice/crio-9cfa9b3135893f9e18d1c0ef16467aaac0c68209b4e22714718afd8137dafbde WatchSource:0}: Error finding container 9cfa9b3135893f9e18d1c0ef16467aaac0c68209b4e22714718afd8137dafbde: Status 404 returned error can't find the container with id 9cfa9b3135893f9e18d1c0ef16467aaac0c68209b4e22714718afd8137dafbde
Jul 23 12:46:24.510963 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.510917    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:46:24.511071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.511022    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:46:24.511071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:24.511066    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:46:25.260212 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:25.260167    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" event={"ID":"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00","Type":"ContainerStarted","Data":"0adaf28786681281faeae295e4af6e54c71eb62fc6d8504b03784a9b910b3c97"}
Jul 23 12:46:25.260425 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:25.260244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" event={"ID":"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00","Type":"ContainerStarted","Data":"9cfa9b3135893f9e18d1c0ef16467aaac0c68209b4e22714718afd8137dafbde"}
Jul 23 12:46:25.282371 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:25.282305    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" podStartSLOduration=1.282286442 podStartE2EDuration="1.282286442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:46:25.280487588 +0000 UTC m=+2187.041606934" watchObservedRunningTime="2026-07-23 12:46:25.282286442 +0000 UTC m=+2187.043405793"
Jul 23 12:46:25.344672 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:25.344624    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:25.350180 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:25.350149    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:26.266379 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:26.266337    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:26.267327 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:26.267307    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:27.254687 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:27.254640    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:27.344156 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:27.344121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:27.767196 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:27.767152    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:27.866898 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:27.866862    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:28.040464 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:28.040360    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:28.141240 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:28.141208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:31.788349 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:31.788302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:34.705738 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:34.705700    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:40.321118 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:40.321078    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:40.423378 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:40.423340    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:42.307762 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:42.307695    2570 patch_prober.go:28] interesting pod/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 12:46:42.308208 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:42.307814    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 12:46:44.381073 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:44.381013    2570 generic.go:356] "Generic (PLEG): container finished" podID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerID="0adaf28786681281faeae295e4af6e54c71eb62fc6d8504b03784a9b910b3c97" exitCode=0
Jul 23 12:46:44.381676 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:44.381094    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" event={"ID":"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00","Type":"ContainerDied","Data":"0adaf28786681281faeae295e4af6e54c71eb62fc6d8504b03784a9b910b3c97"}
Jul 23 12:46:44.381748 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:44.381718    2570 scope.go:117] "RemoveContainer" containerID="0adaf28786681281faeae295e4af6e54c71eb62fc6d8504b03784a9b910b3c97"
Jul 23 12:46:44.382951 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:44.382919    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:46:44.383036 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:44.383018    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:46:44.383091 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:44.383078    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:46:45.389897 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:45.389860    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" event={"ID":"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00","Type":"ContainerStarted","Data":"6d556bd08730bae951b08c3b688406004a3f60a266b7f791f12f16b76b40b2a3"}
Jul 23 12:46:46.345075 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:46.345028    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:46.345553 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:46.345518    2570 patch_prober.go:28] interesting pod/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 23 12:46:46.345808 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:46.345776    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 23 12:46:47.345343 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:47.345292    2570 patch_prober.go:28] interesting pod/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 23 12:46:47.345906 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:47.345391    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 23 12:46:48.345783 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.345195    2570 patch_prober.go:28] interesting pod/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 23 12:46:48.345783 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.345303    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 23 12:46:48.592842 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.592797    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"]
Jul 23 12:46:48.597059 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.596965    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.600678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.600650    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c652bb\"/\"kube-root-ca.crt\""
Jul 23 12:46:48.601010 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.600992    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c652bb\"/\"test-model-c652bb-kserve-self-signed-certs\""
Jul 23 12:46:48.601075 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.601041    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c652bb\"/\"openshift-service-ca.crt\""
Jul 23 12:46:48.601075 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.601055    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c652bb\"/\"default-dockercfg-mkbl4\""
Jul 23 12:46:48.606300 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.606269    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:48.607425 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.607396    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"]
Jul 23 12:46:48.654840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.654005    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-home\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.654840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.654071    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-dshm\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.654840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.654113    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-tmp-dir\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.654840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.654226    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4d97889-ade6-4345-9c89-faaac88cc6cf-tls-certs\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.654840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.654255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-model-cache\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.654840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.654281    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6cmk\" (UniqueName: \"kubernetes.io/projected/c4d97889-ade6-4345-9c89-faaac88cc6cf-kube-api-access-f6cmk\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.759568 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.759534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4d97889-ade6-4345-9c89-faaac88cc6cf-tls-certs\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.759869 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.759839    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-model-cache\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.759869 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.759878    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cmk\" (UniqueName: \"kubernetes.io/projected/c4d97889-ade6-4345-9c89-faaac88cc6cf-kube-api-access-f6cmk\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.760062 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.759958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-home\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.760062 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.759983    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-dshm\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.760062 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.760023    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-tmp-dir\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.760513 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.760486    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-tmp-dir\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.760681 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.760605    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-home\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.760763 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.760684    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-model-cache\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.763602 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.763562    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-dshm\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.764175 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.764149    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4d97889-ade6-4345-9c89-faaac88cc6cf-tls-certs\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.771254 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.771217    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cmk\" (UniqueName: \"kubernetes.io/projected/c4d97889-ade6-4345-9c89-faaac88cc6cf-kube-api-access-f6cmk\") pod \"test-model-c652bb-kserve-58bf8b9b8f-98gc6\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") " pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.910101 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.909993    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:48.974449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:48.974409    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:49.075953 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:49.075883    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:46:49.130376 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:49.130320    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"]
Jul 23 12:46:49.345404 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:49.345362    2570 patch_prober.go:28] interesting pod/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 23 12:46:49.345627 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:49.345431    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 23 12:46:49.416372 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:49.416266    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6" event={"ID":"c4d97889-ade6-4345-9c89-faaac88cc6cf","Type":"ContainerStarted","Data":"9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9"}
Jul 23 12:46:49.416372 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:49.416317    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6" event={"ID":"c4d97889-ade6-4345-9c89-faaac88cc6cf","Type":"ContainerStarted","Data":"b0408af79e31a9d63c849fac56c958cbfb22a9e969c9fda9fa61df330f08d56d"}
Jul 23 12:46:49.440880 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:49.440764    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6" podStartSLOduration=1.440722139 podStartE2EDuration="1.440722139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:46:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:46:49.437660332 +0000 UTC m=+2211.198779684" watchObservedRunningTime="2026-07-23 12:46:49.440722139 +0000 UTC m=+2211.201841489"
Jul 23 12:46:50.349379 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:50.349341    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:50.349780 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:50.349754    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:50.350795 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:50.350775    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:46:58.910662 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:58.910623    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:58.911085 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:58.910679    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:58.923524 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:58.923496    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:59.496898 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:59.496867    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:46:59.756739 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:46:59.756651    2570 scope.go:117] "RemoveContainer" containerID="fe396243383ed8975f5eda8b4d3baf9980292ba03c37ec7556812f014ec113be"
Jul 23 12:47:25.610551 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.610433    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"]
Jul 23 12:47:25.614097 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.614075    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.617532 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.617499    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4551ad\"/\"test-model-4551ad-kserve-self-signed-certs\""
Jul 23 12:47:25.618011 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.617535    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4551ad\"/\"openshift-service-ca.crt\""
Jul 23 12:47:25.618011 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.617512    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4551ad\"/\"default-dockercfg-sddrp\""
Jul 23 12:47:25.618011 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.617511    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4551ad\"/\"kube-root-ca.crt\""
Jul 23 12:47:25.624699 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.624669    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"]
Jul 23 12:47:25.630023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.629994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:47:25.715910 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.715867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-model-cache\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.716109 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.715911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d45672d-d078-40fa-84e2-d7f02aeca253-tls-certs\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.716109 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.715979    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-tmp-dir\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.716109 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.716029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-home\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.716109 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.716044    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-dshm\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.716272 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.716155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94984\" (UniqueName: \"kubernetes.io/projected/9d45672d-d078-40fa-84e2-d7f02aeca253-kube-api-access-94984\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.817498 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.817433    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-home\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.817498 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.817508    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-dshm\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.817776 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.817576    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94984\" (UniqueName: \"kubernetes.io/projected/9d45672d-d078-40fa-84e2-d7f02aeca253-kube-api-access-94984\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.817776 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.817612    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-model-cache\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.817776 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.817628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d45672d-d078-40fa-84e2-d7f02aeca253-tls-certs\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.817776 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.817658    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-tmp-dir\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.817981 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.817904    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-home\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.817981 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.817973    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-model-cache\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.818059 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.818027    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-tmp-dir\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.819808 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.819788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-dshm\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.820199 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.820176    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d45672d-d078-40fa-84e2-d7f02aeca253-tls-certs\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.826711 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.826681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94984\" (UniqueName: \"kubernetes.io/projected/9d45672d-d078-40fa-84e2-d7f02aeca253-kube-api-access-94984\") pod \"test-model-4551ad-kserve-b5fbd7f89-h9tfr\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") " pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:25.926166 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:25.926063    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:26.078102 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:26.078066    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"]
Jul 23 12:47:26.079571 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:47:26.079540    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d45672d_d078_40fa_84e2_d7f02aeca253.slice/crio-aa89220185a3cb80b3ab823c40651c579af5b2c94eaecaa19bf77cdeda2e6e4a WatchSource:0}: Error finding container aa89220185a3cb80b3ab823c40651c579af5b2c94eaecaa19bf77cdeda2e6e4a: Status 404 returned error can't find the container with id aa89220185a3cb80b3ab823c40651c579af5b2c94eaecaa19bf77cdeda2e6e4a
Jul 23 12:47:26.631658 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:26.631619    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr" event={"ID":"9d45672d-d078-40fa-84e2-d7f02aeca253","Type":"ContainerStarted","Data":"04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8"}
Jul 23 12:47:26.631658 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:26.631666    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr" event={"ID":"9d45672d-d078-40fa-84e2-d7f02aeca253","Type":"ContainerStarted","Data":"aa89220185a3cb80b3ab823c40651c579af5b2c94eaecaa19bf77cdeda2e6e4a"}
Jul 23 12:47:26.653576 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:26.653521    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr" podStartSLOduration=1.653502673 podStartE2EDuration="1.653502673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:47:26.653004948 +0000 UTC m=+2248.414124303" watchObservedRunningTime="2026-07-23 12:47:26.653502673 +0000 UTC m=+2248.414622020"
Jul 23 12:47:35.926528 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:35.926456    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:35.926948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:35.926548    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:35.939284 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:35.939258    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:47:36.708817 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:47:36.708786    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:48:07.160106 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:07.160068    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"]
Jul 23 12:48:07.181442 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:07.181409    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:08.099457 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:08.099419    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"]
Jul 23 12:48:08.118303 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:08.118263    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:08.891177 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:08.891143    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:08.992166 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:08.992125    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:18.736421 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:18.736380    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:22.180688 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.180641    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6" podUID="c4d97889-ade6-4345-9c89-faaac88cc6cf" containerName="main" containerID="cri-o://9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9" gracePeriod=45
Jul 23 12:48:22.429425 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.429400    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:48:22.462738 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.462708    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6cmk\" (UniqueName: \"kubernetes.io/projected/c4d97889-ade6-4345-9c89-faaac88cc6cf-kube-api-access-f6cmk\") pod \"c4d97889-ade6-4345-9c89-faaac88cc6cf\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") "
Jul 23 12:48:22.462896 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.462751    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-home\") pod \"c4d97889-ade6-4345-9c89-faaac88cc6cf\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") "
Jul 23 12:48:22.462896 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.462777    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-model-cache\") pod \"c4d97889-ade6-4345-9c89-faaac88cc6cf\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") "
Jul 23 12:48:22.462896 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.462822    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-tmp-dir\") pod \"c4d97889-ade6-4345-9c89-faaac88cc6cf\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") "
Jul 23 12:48:22.462896 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.462891    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-dshm\") pod \"c4d97889-ade6-4345-9c89-faaac88cc6cf\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") "
Jul 23 12:48:22.463132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.462950    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4d97889-ade6-4345-9c89-faaac88cc6cf-tls-certs\") pod \"c4d97889-ade6-4345-9c89-faaac88cc6cf\" (UID: \"c4d97889-ade6-4345-9c89-faaac88cc6cf\") "
Jul 23 12:48:22.463132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.463078    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-home" (OuterVolumeSpecName: "home") pod "c4d97889-ade6-4345-9c89-faaac88cc6cf" (UID: "c4d97889-ade6-4345-9c89-faaac88cc6cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:22.463132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.463072    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4d97889-ade6-4345-9c89-faaac88cc6cf" (UID: "c4d97889-ade6-4345-9c89-faaac88cc6cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:22.463249 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.463134    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4d97889-ade6-4345-9c89-faaac88cc6cf" (UID: "c4d97889-ade6-4345-9c89-faaac88cc6cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:22.463318 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.463295    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:22.463318 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.463314    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:22.463497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.463326    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:22.465171 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.465146    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4d97889-ade6-4345-9c89-faaac88cc6cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4d97889-ade6-4345-9c89-faaac88cc6cf" (UID: "c4d97889-ade6-4345-9c89-faaac88cc6cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:48:22.465259 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.465148    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4d97889-ade6-4345-9c89-faaac88cc6cf-kube-api-access-f6cmk" (OuterVolumeSpecName: "kube-api-access-f6cmk") pod "c4d97889-ade6-4345-9c89-faaac88cc6cf" (UID: "c4d97889-ade6-4345-9c89-faaac88cc6cf"). InnerVolumeSpecName "kube-api-access-f6cmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:48:22.465259 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.465220    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-dshm" (OuterVolumeSpecName: "dshm") pod "c4d97889-ade6-4345-9c89-faaac88cc6cf" (UID: "c4d97889-ade6-4345-9c89-faaac88cc6cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:22.563853 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.563795    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4d97889-ade6-4345-9c89-faaac88cc6cf-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:22.563853 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.563844    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4d97889-ade6-4345-9c89-faaac88cc6cf-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:22.563853 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.563855    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6cmk\" (UniqueName: \"kubernetes.io/projected/c4d97889-ade6-4345-9c89-faaac88cc6cf-kube-api-access-f6cmk\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:22.957923 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.957891    2570 generic.go:356] "Generic (PLEG): container finished" podID="c4d97889-ade6-4345-9c89-faaac88cc6cf" containerID="9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9" exitCode=0
Jul 23 12:48:22.958093 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.957936    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"
Jul 23 12:48:22.958093 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.957979    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6" event={"ID":"c4d97889-ade6-4345-9c89-faaac88cc6cf","Type":"ContainerDied","Data":"9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9"}
Jul 23 12:48:22.958093 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.958019    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6" event={"ID":"c4d97889-ade6-4345-9c89-faaac88cc6cf","Type":"ContainerDied","Data":"b0408af79e31a9d63c849fac56c958cbfb22a9e969c9fda9fa61df330f08d56d"}
Jul 23 12:48:22.958093 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.958042    2570 scope.go:117] "RemoveContainer" containerID="9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9"
Jul 23 12:48:22.967133 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.967098    2570 scope.go:117] "RemoveContainer" containerID="9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9"
Jul 23 12:48:22.967383 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:48:22.967360    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9\": container with ID starting with 9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9 not found: ID does not exist" containerID="9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9"
Jul 23 12:48:22.967464 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.967387    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9"} err="failed to get container status \"9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9\": rpc error: code = NotFound desc = could not find container \"9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9\": container with ID starting with 9969148b923cf12cf74ac0f4445aebb3b8d984a181a275bc14e11e11bb973ae9 not found: ID does not exist"
Jul 23 12:48:22.979391 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.979364    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"]
Jul 23 12:48:22.985205 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:22.985179    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c652bb/test-model-c652bb-kserve-58bf8b9b8f-98gc6"]
Jul 23 12:48:23.120368 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.120272    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr" podUID="9d45672d-d078-40fa-84e2-d7f02aeca253" containerName="main" containerID="cri-o://04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8" gracePeriod=45
Jul 23 12:48:23.329662 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.329632    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:23.375077 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.375014    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:48:23.472298 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472247    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-model-cache\") pod \"9d45672d-d078-40fa-84e2-d7f02aeca253\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") "
Jul 23 12:48:23.472520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472335    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94984\" (UniqueName: \"kubernetes.io/projected/9d45672d-d078-40fa-84e2-d7f02aeca253-kube-api-access-94984\") pod \"9d45672d-d078-40fa-84e2-d7f02aeca253\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") "
Jul 23 12:48:23.472520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472358    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-tmp-dir\") pod \"9d45672d-d078-40fa-84e2-d7f02aeca253\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") "
Jul 23 12:48:23.472520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472391    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-dshm\") pod \"9d45672d-d078-40fa-84e2-d7f02aeca253\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") "
Jul 23 12:48:23.472520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472456    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-home\") pod \"9d45672d-d078-40fa-84e2-d7f02aeca253\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") "
Jul 23 12:48:23.472520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472519    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d45672d-d078-40fa-84e2-d7f02aeca253-tls-certs\") pod \"9d45672d-d078-40fa-84e2-d7f02aeca253\" (UID: \"9d45672d-d078-40fa-84e2-d7f02aeca253\") "
Jul 23 12:48:23.472786 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472568    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-model-cache" (OuterVolumeSpecName: "model-cache") pod "9d45672d-d078-40fa-84e2-d7f02aeca253" (UID: "9d45672d-d078-40fa-84e2-d7f02aeca253"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:23.472786 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472693    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9d45672d-d078-40fa-84e2-d7f02aeca253" (UID: "9d45672d-d078-40fa-84e2-d7f02aeca253"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:23.472875 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472789    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-home" (OuterVolumeSpecName: "home") pod "9d45672d-d078-40fa-84e2-d7f02aeca253" (UID: "9d45672d-d078-40fa-84e2-d7f02aeca253"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:23.472875 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472819    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:23.472875 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.472833    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:23.474734 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.474701    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d45672d-d078-40fa-84e2-d7f02aeca253-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9d45672d-d078-40fa-84e2-d7f02aeca253" (UID: "9d45672d-d078-40fa-84e2-d7f02aeca253"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:48:23.474844 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.474705    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-dshm" (OuterVolumeSpecName: "dshm") pod "9d45672d-d078-40fa-84e2-d7f02aeca253" (UID: "9d45672d-d078-40fa-84e2-d7f02aeca253"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:23.474844 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.474734    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d45672d-d078-40fa-84e2-d7f02aeca253-kube-api-access-94984" (OuterVolumeSpecName: "kube-api-access-94984") pod "9d45672d-d078-40fa-84e2-d7f02aeca253" (UID: "9d45672d-d078-40fa-84e2-d7f02aeca253"). InnerVolumeSpecName "kube-api-access-94984". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:48:23.573306 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.573268    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:23.573306 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.573298    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d45672d-d078-40fa-84e2-d7f02aeca253-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:23.573306 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.573308    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94984\" (UniqueName: \"kubernetes.io/projected/9d45672d-d078-40fa-84e2-d7f02aeca253-kube-api-access-94984\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:23.573583 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.573319    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d45672d-d078-40fa-84e2-d7f02aeca253-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:23.788531 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.788498    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:23.965910 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.965875    2570 generic.go:356] "Generic (PLEG): container finished" podID="9d45672d-d078-40fa-84e2-d7f02aeca253" containerID="04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8" exitCode=0
Jul 23 12:48:23.965910 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.965915    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"
Jul 23 12:48:23.966146 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.965962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr" event={"ID":"9d45672d-d078-40fa-84e2-d7f02aeca253","Type":"ContainerDied","Data":"04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8"}
Jul 23 12:48:23.966146 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.966002    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr" event={"ID":"9d45672d-d078-40fa-84e2-d7f02aeca253","Type":"ContainerDied","Data":"aa89220185a3cb80b3ab823c40651c579af5b2c94eaecaa19bf77cdeda2e6e4a"}
Jul 23 12:48:23.966146 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.966022    2570 scope.go:117] "RemoveContainer" containerID="04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8"
Jul 23 12:48:23.975916 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.975898    2570 scope.go:117] "RemoveContainer" containerID="04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8"
Jul 23 12:48:23.976189 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:48:23.976170    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8\": container with ID starting with 04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8 not found: ID does not exist" containerID="04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8"
Jul 23 12:48:23.976231 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.976198    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8"} err="failed to get container status \"04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8\": rpc error: code = NotFound desc = could not find container \"04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8\": container with ID starting with 04ce397cd1a4782ab651b21bdd249b749dbced17e0c9988578c88f9d47a5a0e8 not found: ID does not exist"
Jul 23 12:48:23.991259 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.991226    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"]
Jul 23 12:48:23.998519 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:23.998493    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4551ad/test-model-4551ad-kserve-b5fbd7f89-h9tfr"]
Jul 23 12:48:24.738024 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:24.737993    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d45672d-d078-40fa-84e2-d7f02aeca253" path="/var/lib/kubelet/pods/9d45672d-d078-40fa-84e2-d7f02aeca253/volumes"
Jul 23 12:48:24.738402 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:24.738380    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4d97889-ade6-4345-9c89-faaac88cc6cf" path="/var/lib/kubelet/pods/c4d97889-ade6-4345-9c89-faaac88cc6cf/volumes"
Jul 23 12:48:30.358863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:30.358822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:30.456497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:30.456434    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:30.648367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:30.648278    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:30.891810 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:30.891770    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:31.696798 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:31.696760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:31.792838 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:31.792805    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:41.654196 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:41.654163    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:46.097967 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:46.097932    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:46.549371 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:46.549339    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:52.736020 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:52.735932    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:52.792542 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:52.792504    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:53.009732 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:53.009636    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"]
Jul 23 12:48:53.009888 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:53.009858    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy" containerID="cri-o://6d556bd08730bae951b08c3b688406004a3f60a266b7f791f12f16b76b40b2a3" gracePeriod=30
Jul 23 12:48:53.027818 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:53.027782    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:53.483075 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:53.483042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:53.644772 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:53.644743    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:53.984912 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:53.984876    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:54.280174 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:54.280096    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:56.588617 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:56.588581    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:56.682621 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:56.682588    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:56.752210 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:56.752171    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:56.928405 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:56.928319    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:57.334411 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:57.334376    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:57.435255 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:57.435219    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:48:58.154014 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.153986    2570 generic.go:356] "Generic (PLEG): container finished" podID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerID="6d556bd08730bae951b08c3b688406004a3f60a266b7f791f12f16b76b40b2a3" exitCode=0
Jul 23 12:48:58.154328 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.154032    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" event={"ID":"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00","Type":"ContainerDied","Data":"6d556bd08730bae951b08c3b688406004a3f60a266b7f791f12f16b76b40b2a3"}
Jul 23 12:48:58.154328 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.154080    2570 scope.go:117] "RemoveContainer" containerID="0adaf28786681281faeae295e4af6e54c71eb62fc6d8504b03784a9b910b3c97"
Jul 23 12:48:58.264351 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.264329    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:48:58.385565 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385497    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-token\") pod \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") "
Jul 23 12:48:58.385565 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385554    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istiod-ca-cert\") pod \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") "
Jul 23 12:48:58.385713 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385650    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-envoy\") pod \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") "
Jul 23 12:48:58.385713 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385679    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-data\") pod \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") "
Jul 23 12:48:58.385713 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385709    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-certs\") pod \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") "
Jul 23 12:48:58.385859 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385736    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-credential-socket\") pod \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") "
Jul 23 12:48:58.385859 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385801    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-podinfo\") pod \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") "
Jul 23 12:48:58.385859 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385834    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-socket\") pod \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") "
Jul 23 12:48:58.386013 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385888    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q67j7\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-kube-api-access-q67j7\") pod \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\" (UID: \"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00\") "
Jul 23 12:48:58.386013 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.385945    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" (UID: "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:48:58.386182 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.386015    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" (UID: "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:58.386182 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.386033    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" (UID: "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:58.386291 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.386230    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" (UID: "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:58.386291 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.386254    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istiod-ca-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:58.386291 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.386276    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:58.386291 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.386289    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-credential-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:58.386534 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.386512    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" (UID: "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:58.387725 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.387696    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" (UID: "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:48:58.387831 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.387784    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" (UID: "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 12:48:58.388113 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.388085    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" (UID: "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:48:58.388210 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.388153    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-kube-api-access-q67j7" (OuterVolumeSpecName: "kube-api-access-q67j7") pod "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" (UID: "c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00"). InnerVolumeSpecName "kube-api-access-q67j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:48:58.487585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.487563    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-token\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:58.487585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.487582    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-envoy\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:58.487718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.487591    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-data\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:58.487718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.487601    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-istio-podinfo\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:58.487718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.487609    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-workload-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:58.487718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:58.487619    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q67j7\" (UniqueName: \"kubernetes.io/projected/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00-kube-api-access-q67j7\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:48:59.160600 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:59.160523    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"
Jul 23 12:48:59.160600 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:59.160548    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt" event={"ID":"c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00","Type":"ContainerDied","Data":"9cfa9b3135893f9e18d1c0ef16467aaac0c68209b4e22714718afd8137dafbde"}
Jul 23 12:48:59.161051 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:59.160637    2570 scope.go:117] "RemoveContainer" containerID="6d556bd08730bae951b08c3b688406004a3f60a266b7f791f12f16b76b40b2a3"
Jul 23 12:48:59.181607 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:59.181582    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"]
Jul 23 12:48:59.188840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:48:59.188820    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4551ad-openshift-default-756485847f-2slkt"]
Jul 23 12:49:00.738411 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:00.738380    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" path="/var/lib/kubelet/pods/c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00/volumes"
Jul 23 12:49:01.151917 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.151837    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:01.681518 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.681463    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:01.999181 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999151    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"]
Jul 23 12:49:01.999586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999514    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy"
Jul 23 12:49:01.999586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999527    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy"
Jul 23 12:49:01.999586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999535    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4d97889-ade6-4345-9c89-faaac88cc6cf" containerName="main"
Jul 23 12:49:01.999586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999540    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4d97889-ade6-4345-9c89-faaac88cc6cf" containerName="main"
Jul 23 12:49:01.999586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999549    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy"
Jul 23 12:49:01.999586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999554    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy"
Jul 23 12:49:01.999586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999564    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d45672d-d078-40fa-84e2-d7f02aeca253" containerName="main"
Jul 23 12:49:01.999586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999569    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d45672d-d078-40fa-84e2-d7f02aeca253" containerName="main"
Jul 23 12:49:01.999864 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999634    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4d97889-ade6-4345-9c89-faaac88cc6cf" containerName="main"
Jul 23 12:49:01.999864 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999643    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d45672d-d078-40fa-84e2-d7f02aeca253" containerName="main"
Jul 23 12:49:01.999864 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999650    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy"
Jul 23 12:49:01.999864 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:01.999656    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5bb8b5a-bfbe-4720-b06d-18d28d0a0d00" containerName="istio-proxy"
Jul 23 12:49:02.004068 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.004052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.006450 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.006430    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-52006d-openshift-default-dockercfg-tfzs9\""
Jul 23 12:49:02.019842 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.019817    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"]
Jul 23 12:49:02.038017 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.037990    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:02.109346 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.109322    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:02.115441 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.115420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-envoy\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.115537 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.115449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-podinfo\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.115537 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.115522    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-data\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.115647 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.115560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-credential-socket\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.115647 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.115599    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-certs\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.115726 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.115655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/611399ec-bfe6-4c05-8d06-353e6475c6b9-istiod-ca-cert\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.115726 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.115701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-token\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.115726 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.115722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-socket\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.115839 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.115737    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wz2c\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-kube-api-access-9wz2c\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217002 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.216972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-envoy\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217002 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217004    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-podinfo\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217028    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-data\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-credential-socket\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-certs\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217206 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217193    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/611399ec-bfe6-4c05-8d06-353e6475c6b9-istiod-ca-cert\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217411 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217271    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-token\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217411 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217324    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-socket\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217411 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wz2c\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-kube-api-access-9wz2c\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217611 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-data\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217611 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217495    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-credential-socket\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217611 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217552    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-certs\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.217775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.217739    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-socket\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.218109 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.218072    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/611399ec-bfe6-4c05-8d06-353e6475c6b9-istiod-ca-cert\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.219528 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.219505    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-envoy\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.219759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.219702    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-podinfo\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.226653 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.226626    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-token\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.226759 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.226743    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wz2c\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-kube-api-access-9wz2c\") pod \"e2e-api-b-52006d-openshift-default-69f456659f-wfkwc\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") " pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.314363 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.314305    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:02.449928 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.449901    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"]
Jul 23 12:49:02.451943 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:49:02.451915    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611399ec_bfe6_4c05_8d06_353e6475c6b9.slice/crio-0fc8d17022480d575638ef5f4582957817fec5db3b084c77811a0c5df2ba90fa WatchSource:0}: Error finding container 0fc8d17022480d575638ef5f4582957817fec5db3b084c77811a0c5df2ba90fa: Status 404 returned error can't find the container with id 0fc8d17022480d575638ef5f4582957817fec5db3b084c77811a0c5df2ba90fa
Jul 23 12:49:02.454143 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.454102    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:49:02.454224 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.454196    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:49:02.454266 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:02.454240    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:49:03.181301 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:03.181267    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" event={"ID":"611399ec-bfe6-4c05-8d06-353e6475c6b9","Type":"ContainerStarted","Data":"e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b"}
Jul 23 12:49:03.181714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:03.181319    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" event={"ID":"611399ec-bfe6-4c05-8d06-353e6475c6b9","Type":"ContainerStarted","Data":"0fc8d17022480d575638ef5f4582957817fec5db3b084c77811a0c5df2ba90fa"}
Jul 23 12:49:03.315433 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:03.315406    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:03.320147 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:03.320121    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:03.345657 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:03.345605    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" podStartSLOduration=2.345584655 podStartE2EDuration="2.345584655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:49:03.213064385 +0000 UTC m=+2344.974183736" watchObservedRunningTime="2026-07-23 12:49:03.345584655 +0000 UTC m=+2345.106704006"
Jul 23 12:49:04.186254 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:04.186221    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:04.187602 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:04.187579    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:05.162557 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:05.162508    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:05.253137 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:05.253105    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:05.351533 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:05.351503    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:05.541294 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:05.541257    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:05.996526 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:05.996490    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:06.102681 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:06.102641    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:09.695669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:09.695634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:18.566946 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:18.566911    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:18.667332 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:18.667292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:22.299309 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:22.299214    2570 generic.go:356] "Generic (PLEG): container finished" podID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerID="e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b" exitCode=0
Jul 23 12:49:22.299309 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:22.299290    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" event={"ID":"611399ec-bfe6-4c05-8d06-353e6475c6b9","Type":"ContainerDied","Data":"e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b"}
Jul 23 12:49:22.299881 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:22.299728    2570 scope.go:117] "RemoveContainer" containerID="e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b"
Jul 23 12:49:22.300844 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:22.300810    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:49:22.300960 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:22.300887    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:49:22.300960 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:22.300920    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:49:23.307322 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:23.307280    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" event={"ID":"611399ec-bfe6-4c05-8d06-353e6475c6b9","Type":"ContainerStarted","Data":"85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d"}
Jul 23 12:49:23.314987 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:23.314952    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:23.315240 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:23.315216    2570 patch_prober.go:28] interesting pod/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 23 12:49:23.315289 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:23.315267    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 23 12:49:24.315319 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:24.315272    2570 patch_prober.go:28] interesting pod/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 23 12:49:24.315861 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:24.315339    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 23 12:49:25.314795 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:25.314757    2570 patch_prober.go:28] interesting pod/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 23 12:49:25.314994 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:25.314835    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 23 12:49:26.315160 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:26.315112    2570 patch_prober.go:28] interesting pod/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 23 12:49:26.315691 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:26.315183    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 23 12:49:26.937998 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:26.937948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:27.018586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:27.018546    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:27.315789 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:27.315750    2570 patch_prober.go:28] interesting pod/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 23 12:49:27.316160 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:27.315812    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 23 12:49:28.319326 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:28.319280    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:28.319831 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:28.319620    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:28.320560 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:28.320540    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:49:28.684151 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:28.684052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:28.783375 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:28.783340    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:33.966748 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:33.966709    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:38.071005 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:38.070967    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:38.477393 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:38.477363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:44.825525 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:44.825487    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:44.877435 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:44.877397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:45.139777 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:45.139665    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:45.372399 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:45.372361    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:46.085138 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:46.085101    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:46.185414 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:46.185376    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:49:58.845949 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:58.845918    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:49:58.848904 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:49:58.848879    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:50:00.566456 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:00.566413    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:00.667522 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:00.667454    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:01.010174 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:01.010143    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:05.610543 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:05.610506    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:06.014401 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:06.014362    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:11.925036 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:11.924994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:12.025585 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:12.025552    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:12.183233 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:12.183142    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"]
Jul 23 12:50:12.183439 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:12.183412    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy" containerID="cri-o://85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d" gracePeriod=30
Jul 23 12:50:12.206310 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:12.206269    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:12.453736 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:12.453632    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:12.835215 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:12.835178    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:13.190388 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:13.190295    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:13.322328 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:13.322285    2570 patch_prober.go:28] interesting pod/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 12:50:13.322521 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:13.322359    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 12:50:13.785586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:13.785548    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:16.033446 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:16.033411    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:16.128123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:16.128092    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:16.233736 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:16.233704    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:16.392553 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:16.392453    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:16.823707 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:16.823674    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:16.924854 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:16.924821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:17.445151 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.445087    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:50:17.526497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526427    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wz2c\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-kube-api-access-9wz2c\") pod \"611399ec-bfe6-4c05-8d06-353e6475c6b9\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") "
Jul 23 12:50:17.526497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526497    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/611399ec-bfe6-4c05-8d06-353e6475c6b9-istiod-ca-cert\") pod \"611399ec-bfe6-4c05-8d06-353e6475c6b9\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") "
Jul 23 12:50:17.526775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526554    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-podinfo\") pod \"611399ec-bfe6-4c05-8d06-353e6475c6b9\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") "
Jul 23 12:50:17.526775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526570    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-socket\") pod \"611399ec-bfe6-4c05-8d06-353e6475c6b9\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") "
Jul 23 12:50:17.526775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526590    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-data\") pod \"611399ec-bfe6-4c05-8d06-353e6475c6b9\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") "
Jul 23 12:50:17.526775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526608    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-envoy\") pod \"611399ec-bfe6-4c05-8d06-353e6475c6b9\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") "
Jul 23 12:50:17.526775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526629    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-credential-socket\") pod \"611399ec-bfe6-4c05-8d06-353e6475c6b9\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") "
Jul 23 12:50:17.526775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526750    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-certs\") pod \"611399ec-bfe6-4c05-8d06-353e6475c6b9\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") "
Jul 23 12:50:17.527108 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526781    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-token\") pod \"611399ec-bfe6-4c05-8d06-353e6475c6b9\" (UID: \"611399ec-bfe6-4c05-8d06-353e6475c6b9\") "
Jul 23 12:50:17.527108 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526881    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "611399ec-bfe6-4c05-8d06-353e6475c6b9" (UID: "611399ec-bfe6-4c05-8d06-353e6475c6b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:50:17.527108 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.526929    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/611399ec-bfe6-4c05-8d06-353e6475c6b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "611399ec-bfe6-4c05-8d06-353e6475c6b9" (UID: "611399ec-bfe6-4c05-8d06-353e6475c6b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:50:17.527289 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.527161    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "611399ec-bfe6-4c05-8d06-353e6475c6b9" (UID: "611399ec-bfe6-4c05-8d06-353e6475c6b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:50:17.527289 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.527200    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/611399ec-bfe6-4c05-8d06-353e6475c6b9-istiod-ca-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:50:17.527289 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.527217    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:50:17.527447 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.527333    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "611399ec-bfe6-4c05-8d06-353e6475c6b9" (UID: "611399ec-bfe6-4c05-8d06-353e6475c6b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:50:17.527526 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.527454    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "611399ec-bfe6-4c05-8d06-353e6475c6b9" (UID: "611399ec-bfe6-4c05-8d06-353e6475c6b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:50:17.528901 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.528869    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-kube-api-access-9wz2c" (OuterVolumeSpecName: "kube-api-access-9wz2c") pod "611399ec-bfe6-4c05-8d06-353e6475c6b9" (UID: "611399ec-bfe6-4c05-8d06-353e6475c6b9"). InnerVolumeSpecName "kube-api-access-9wz2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:50:17.529016 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.528913    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "611399ec-bfe6-4c05-8d06-353e6475c6b9" (UID: "611399ec-bfe6-4c05-8d06-353e6475c6b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 12:50:17.529063 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.529021    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "611399ec-bfe6-4c05-8d06-353e6475c6b9" (UID: "611399ec-bfe6-4c05-8d06-353e6475c6b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:50:17.529063 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.529039    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "611399ec-bfe6-4c05-8d06-353e6475c6b9" (UID: "611399ec-bfe6-4c05-8d06-353e6475c6b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:50:17.606157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.606121    2570 generic.go:356] "Generic (PLEG): container finished" podID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerID="85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d" exitCode=0
Jul 23 12:50:17.606347 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.606168    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"
Jul 23 12:50:17.606347 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.606200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" event={"ID":"611399ec-bfe6-4c05-8d06-353e6475c6b9","Type":"ContainerDied","Data":"85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d"}
Jul 23 12:50:17.606347 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.606254    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc" event={"ID":"611399ec-bfe6-4c05-8d06-353e6475c6b9","Type":"ContainerDied","Data":"0fc8d17022480d575638ef5f4582957817fec5db3b084c77811a0c5df2ba90fa"}
Jul 23 12:50:17.606347 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.606276    2570 scope.go:117] "RemoveContainer" containerID="85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d"
Jul 23 12:50:17.615646 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.615629    2570 scope.go:117] "RemoveContainer" containerID="e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b"
Jul 23 12:50:17.624783 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.624758    2570 scope.go:117] "RemoveContainer" containerID="85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d"
Jul 23 12:50:17.625106 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:50:17.625086    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d\": container with ID starting with 85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d not found: ID does not exist" containerID="85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d"
Jul 23 12:50:17.625158 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.625117    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d"} err="failed to get container status \"85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d\": rpc error: code = NotFound desc = could not find container \"85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d\": container with ID starting with 85f6760fb77d7722cda863fa878bb187b091be86bda232ee9417baa70e50764d not found: ID does not exist"
Jul 23 12:50:17.625158 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.625138    2570 scope.go:117] "RemoveContainer" containerID="e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b"
Jul 23 12:50:17.625411 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:50:17.625394    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b\": container with ID starting with e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b not found: ID does not exist" containerID="e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b"
Jul 23 12:50:17.625538 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.625416    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b"} err="failed to get container status \"e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b\": rpc error: code = NotFound desc = could not find container \"e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b\": container with ID starting with e5d544e48ea42fb2f5ce1783504f19cdae32affeb24e8287b40b341dda24772b not found: ID does not exist"
Jul 23 12:50:17.627956 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.627932    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-data\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:50:17.627956 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.627955    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-envoy\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:50:17.628099 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.627964    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-credential-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:50:17.628099 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.627973    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/611399ec-bfe6-4c05-8d06-353e6475c6b9-workload-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:50:17.628099 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.627982    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-token\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:50:17.628099 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.627990    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wz2c\" (UniqueName: \"kubernetes.io/projected/611399ec-bfe6-4c05-8d06-353e6475c6b9-kube-api-access-9wz2c\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:50:17.628099 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.627999    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/611399ec-bfe6-4c05-8d06-353e6475c6b9-istio-podinfo\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:50:17.629213 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.629193    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"]
Jul 23 12:50:17.633633 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:17.633609    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-52006d-openshift-default-69f456659f-wfkwc"]
Jul 23 12:50:18.740319 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:18.740283    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" path="/var/lib/kubelet/pods/611399ec-bfe6-4c05-8d06-353e6475c6b9/volumes"
Jul 23 12:50:20.568132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:20.568095    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:20.885398 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:20.885310    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:21.186943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.186802    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"]
Jul 23 12:50:21.187354 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.187333    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy"
Jul 23 12:50:21.187354 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.187354    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy"
Jul 23 12:50:21.187552 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.187371    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy"
Jul 23 12:50:21.187552 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.187377    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy"
Jul 23 12:50:21.187552 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.187432    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy"
Jul 23 12:50:21.192080 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.192049    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.194686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.194659    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-474ecb-openshift-default-dockercfg-86q2k\""
Jul 23 12:50:21.202655 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.202622    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"]
Jul 23 12:50:21.219811 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.219775    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:21.362013 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.361963    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-credential-socket\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.362013 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.362004    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-token\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.362283 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.362038    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-socket\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.362283 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.362067    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-podinfo\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.362283 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.362097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-data\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.362283 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.362147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-certs\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.362283 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.362163    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwsp\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-kube-api-access-ppwsp\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.362283 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.362196    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-envoy\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.362283 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.362214    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istiod-ca-cert\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463291 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-credential-socket\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-token\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463320    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-socket\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-podinfo\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463497 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463457    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-data\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463721 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-certs\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463721 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwsp\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-kube-api-access-ppwsp\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463721 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-envoy\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463721 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istiod-ca-cert\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463930 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463764    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-credential-socket\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463930 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463818    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-socket\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.463930 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463866    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-data\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.464030 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.463928    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-certs\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.464271 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.464251    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istiod-ca-cert\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.465816 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.465794    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-envoy\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.465932 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.465857    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-podinfo\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.471673 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.471643    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:21.472229 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.472204    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwsp\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-kube-api-access-ppwsp\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.472288 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.472209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-token\") pod \"e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") " pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.505567 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.505513    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:21.656900 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.656872    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"]
Jul 23 12:50:21.658964 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:50:21.658926    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3070c6_f75b_4a8f_8661_cb289fb2a1ae.slice/crio-28cd7133e3e015eaa5abffcaab48f5a312b044e1671200c45246223e943266b1 WatchSource:0}: Error finding container 28cd7133e3e015eaa5abffcaab48f5a312b044e1671200c45246223e943266b1: Status 404 returned error can't find the container with id 28cd7133e3e015eaa5abffcaab48f5a312b044e1671200c45246223e943266b1
Jul 23 12:50:21.661296 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.661258    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:50:21.661397 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.661340    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:50:21.661397 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:21.661390    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:50:22.638109 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:22.638073    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" event={"ID":"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae","Type":"ContainerStarted","Data":"3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca"}
Jul 23 12:50:22.638311 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:22.638130    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" event={"ID":"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae","Type":"ContainerStarted","Data":"28cd7133e3e015eaa5abffcaab48f5a312b044e1671200c45246223e943266b1"}
Jul 23 12:50:22.662002 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:22.661947    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" podStartSLOduration=1.661929505 podStartE2EDuration="1.661929505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:50:22.659756474 +0000 UTC m=+2424.420875825" watchObservedRunningTime="2026-07-23 12:50:22.661929505 +0000 UTC m=+2424.423048860"
Jul 23 12:50:23.506731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:23.506682    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:23.513262 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:23.513229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:23.644163 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:23.644127    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:23.645223 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:23.645205    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:24.677500 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:24.677443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:24.755902 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:24.755868    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:24.823575 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:24.823540    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:25.084970 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:25.084932    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:25.374435 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:25.374347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:25.473803 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:25.473764    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:29.222348 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:29.222311    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:36.723417 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:36.723377    2570 generic.go:356] "Generic (PLEG): container finished" podID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerID="3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca" exitCode=0
Jul 23 12:50:36.724037 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:36.723446    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" event={"ID":"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae","Type":"ContainerDied","Data":"3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca"}
Jul 23 12:50:36.724037 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:36.723983    2570 scope.go:117] "RemoveContainer" containerID="3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca"
Jul 23 12:50:36.725333 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:36.725299    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:50:36.725434 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:36.725407    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:50:36.725516 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:36.725456    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 12:50:37.647486 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:37.647366    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:37.731076 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:37.731046    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" event={"ID":"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae","Type":"ContainerStarted","Data":"07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d"}
Jul 23 12:50:37.747752 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:37.747715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:38.506757 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:38.506715    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:38.508025 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:38.507999    2570 patch_prober.go:28] interesting pod/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 23 12:50:38.508105 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:38.508064    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 23 12:50:38.644896 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:38.644850    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:39.506760 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:39.506715    2570 patch_prober.go:28] interesting pod/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 23 12:50:39.507198 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:39.506783    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 23 12:50:40.506720 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:40.506686    2570 patch_prober.go:28] interesting pod/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 23 12:50:40.506902 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:40.506740    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 23 12:50:41.505918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:41.505877    2570 patch_prober.go:28] interesting pod/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 23 12:50:41.506112 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:41.505937    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 23 12:50:42.510921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.510886    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:42.512396 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.512374    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:50:42.513852 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.513829    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"]
Jul 23 12:50:42.514260 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.514249    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="611399ec-bfe6-4c05-8d06-353e6475c6b9" containerName="istio-proxy"
Jul 23 12:50:42.517813 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.517793    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.520090 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.520067    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d45fc5\"/\"openshift-service-ca.crt\""
Jul 23 12:50:42.520236 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.520111    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d45fc5\"/\"auth-test-model-d45fc5-kserve-self-signed-certs\""
Jul 23 12:50:42.520236 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.520067    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d45fc5\"/\"default-dockercfg-sdwcm\""
Jul 23 12:50:42.520236 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.520074    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d45fc5\"/\"kube-root-ca.crt\""
Jul 23 12:50:42.528632 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.528601    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"]
Jul 23 12:50:42.552511 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.552411    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:42.576144 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.576099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-tmp-dir\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.576344 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.576156    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-dshm\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.576344 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.576285    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-home\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.576460 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.576346    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0493d294-6937-40b3-a065-be0ef18fc2ef-tls-certs\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.576460 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.576394    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-model-cache\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.576460 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.576422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nwz\" (UniqueName: \"kubernetes.io/projected/0493d294-6937-40b3-a065-be0ef18fc2ef-kube-api-access-x7nwz\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.677550 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.677509    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-tmp-dir\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.677550 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.677568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-dshm\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.677854 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.677636    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-home\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.677854 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.677671    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0493d294-6937-40b3-a065-be0ef18fc2ef-tls-certs\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.677854 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.677718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-model-cache\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.677854 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.677752    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nwz\" (UniqueName: \"kubernetes.io/projected/0493d294-6937-40b3-a065-be0ef18fc2ef-kube-api-access-x7nwz\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.678053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.678009    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-tmp-dir\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.678203 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.678159    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-home\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.678375 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.678301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-model-cache\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.680903 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.680882    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-dshm\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.681173 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.681153    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0493d294-6937-40b3-a065-be0ef18fc2ef-tls-certs\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.687949 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.687919    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nwz\" (UniqueName: \"kubernetes.io/projected/0493d294-6937-40b3-a065-be0ef18fc2ef-kube-api-access-x7nwz\") pod \"auth-test-model-d45fc5-kserve-7ccf656855-n4bfr\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") " pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.828539 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.828416    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:42.969538 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:42.969434    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"]
Jul 23 12:50:42.971810 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:50:42.971780    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0493d294_6937_40b3_a065_be0ef18fc2ef.slice/crio-399c8bfa1987aa92cd6802e938ba7d1235f36f7269f04a2915f7a5f4a9c6f434 WatchSource:0}: Error finding container 399c8bfa1987aa92cd6802e938ba7d1235f36f7269f04a2915f7a5f4a9c6f434: Status 404 returned error can't find the container with id 399c8bfa1987aa92cd6802e938ba7d1235f36f7269f04a2915f7a5f4a9c6f434
Jul 23 12:50:43.774810 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:43.774770    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr" event={"ID":"0493d294-6937-40b3-a065-be0ef18fc2ef","Type":"ContainerStarted","Data":"c4a6f3c1f1b2437a2b45b871cf535c3111d07d0b2173a26c16af84c914e0759a"}
Jul 23 12:50:43.775269 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:43.774816    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr" event={"ID":"0493d294-6937-40b3-a065-be0ef18fc2ef","Type":"ContainerStarted","Data":"399c8bfa1987aa92cd6802e938ba7d1235f36f7269f04a2915f7a5f4a9c6f434"}
Jul 23 12:50:43.794329 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:43.794275    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr" podStartSLOduration=1.794256709 podStartE2EDuration="1.794256709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:50:43.79354506 +0000 UTC m=+2445.554664412" watchObservedRunningTime="2026-07-23 12:50:43.794256709 +0000 UTC m=+2445.555376103"
Jul 23 12:50:46.160275 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:46.160241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:46.260785 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:46.260751    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:48.858123 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:48.858088    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:48.913287 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:48.913255    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:50:52.829281 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:52.829243    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:52.829771 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:52.829296    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:52.842113 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:52.842081    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:50:53.843121 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:50:53.843090    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:51:05.001196 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.001156    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"]
Jul 23 12:51:05.007039 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.007003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.009620 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.009580    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"kube-root-ca.crt\""
Jul 23 12:51:05.009856 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.009832    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"openshift-service-ca.crt\""
Jul 23 12:51:05.010577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.010504    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"auth-test-model-474ecb-kserve-self-signed-certs\""
Jul 23 12:51:05.010770 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.010669    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"default-dockercfg-kt5hf\""
Jul 23 12:51:05.014140 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.014115    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"]
Jul 23 12:51:05.036357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.036316    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:51:05.091883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.091842    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stzgx\" (UniqueName: \"kubernetes.io/projected/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-kube-api-access-stzgx\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.092168 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.091903    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-home\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.092168 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.091975    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tls-certs\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.092168 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.092069    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-model-cache\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.092168 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.092150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-dshm\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.092334 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.092192    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tmp-dir\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.193078 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.193038    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-model-cache\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.193294 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.193105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-dshm\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.193294 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.193126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tmp-dir\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.193294 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.193226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stzgx\" (UniqueName: \"kubernetes.io/projected/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-kube-api-access-stzgx\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.193522 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.193309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-home\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.193522 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.193374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tls-certs\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.193522 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.193510    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-model-cache\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.193689 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.193560    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tmp-dir\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.193689 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.193656    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-home\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.195463 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.195442    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-dshm\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.195970 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.195949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tls-certs\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.203461 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.203428    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stzgx\" (UniqueName: \"kubernetes.io/projected/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-kube-api-access-stzgx\") pod \"auth-test-model-474ecb-kserve-75fd57777f-h4gt5\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") " pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.318940 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.318828    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:05.462960 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.462933    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"]
Jul 23 12:51:05.464644 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:51:05.464611    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6f1c145_cb53_485b_82b5_8cc2c1a13abe.slice/crio-150a63a163bed79427f74d63ea2f9788eaddccc487cbede8d46d2c08cfcdb618 WatchSource:0}: Error finding container 150a63a163bed79427f74d63ea2f9788eaddccc487cbede8d46d2c08cfcdb618: Status 404 returned error can't find the container with id 150a63a163bed79427f74d63ea2f9788eaddccc487cbede8d46d2c08cfcdb618
Jul 23 12:51:05.902679 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.902628    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5" event={"ID":"b6f1c145-cb53-485b-82b5-8cc2c1a13abe","Type":"ContainerStarted","Data":"677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d"}
Jul 23 12:51:05.902679 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.902684    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5" event={"ID":"b6f1c145-cb53-485b-82b5-8cc2c1a13abe","Type":"ContainerStarted","Data":"150a63a163bed79427f74d63ea2f9788eaddccc487cbede8d46d2c08cfcdb618"}
Jul 23 12:51:05.923376 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:05.923315    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5" podStartSLOduration=1.923298023 podStartE2EDuration="1.923298023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:51:05.920549048 +0000 UTC m=+2467.681668400" watchObservedRunningTime="2026-07-23 12:51:05.923298023 +0000 UTC m=+2467.684417374"
Jul 23 12:51:15.319031 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:15.318992    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:15.319573 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:15.319049    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:15.332011 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:15.331964    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:15.970717 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:15.970685    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:51:43.583251 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:51:43.583202    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:52:42.171868 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:52:42.171825    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:53:09.500001 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:09.499961    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"]
Jul 23 12:53:09.520201 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:09.520170    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:53:10.319488 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:10.319441    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"]
Jul 23 12:53:10.341023 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:10.340989    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:53:24.520377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.520287    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr" podUID="0493d294-6937-40b3-a065-be0ef18fc2ef" containerName="main" containerID="cri-o://c4a6f3c1f1b2437a2b45b871cf535c3111d07d0b2173a26c16af84c914e0759a" gracePeriod=45
Jul 23 12:53:24.673842 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.673805    2570 generic.go:356] "Generic (PLEG): container finished" podID="0493d294-6937-40b3-a065-be0ef18fc2ef" containerID="c4a6f3c1f1b2437a2b45b871cf535c3111d07d0b2173a26c16af84c914e0759a" exitCode=0
Jul 23 12:53:24.673842 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.673835    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr" event={"ID":"0493d294-6937-40b3-a065-be0ef18fc2ef","Type":"ContainerDied","Data":"c4a6f3c1f1b2437a2b45b871cf535c3111d07d0b2173a26c16af84c914e0759a"}
Jul 23 12:53:24.785265 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.785191    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:53:24.933325 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933273    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-model-cache\") pod \"0493d294-6937-40b3-a065-be0ef18fc2ef\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") "
Jul 23 12:53:24.933547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933343    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-dshm\") pod \"0493d294-6937-40b3-a065-be0ef18fc2ef\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") "
Jul 23 12:53:24.933547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933387    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7nwz\" (UniqueName: \"kubernetes.io/projected/0493d294-6937-40b3-a065-be0ef18fc2ef-kube-api-access-x7nwz\") pod \"0493d294-6937-40b3-a065-be0ef18fc2ef\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") "
Jul 23 12:53:24.933547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933443    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-home\") pod \"0493d294-6937-40b3-a065-be0ef18fc2ef\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") "
Jul 23 12:53:24.933547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933508    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-tmp-dir\") pod \"0493d294-6937-40b3-a065-be0ef18fc2ef\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") "
Jul 23 12:53:24.933547 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933533    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0493d294-6937-40b3-a065-be0ef18fc2ef-tls-certs\") pod \"0493d294-6937-40b3-a065-be0ef18fc2ef\" (UID: \"0493d294-6937-40b3-a065-be0ef18fc2ef\") "
Jul 23 12:53:24.933842 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933682    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "0493d294-6937-40b3-a065-be0ef18fc2ef" (UID: "0493d294-6937-40b3-a065-be0ef18fc2ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:53:24.933842 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933769    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0493d294-6937-40b3-a065-be0ef18fc2ef" (UID: "0493d294-6937-40b3-a065-be0ef18fc2ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:53:24.933842 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933778    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-home" (OuterVolumeSpecName: "home") pod "0493d294-6937-40b3-a065-be0ef18fc2ef" (UID: "0493d294-6937-40b3-a065-be0ef18fc2ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:53:24.934007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933910    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:24.934007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933923    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:24.934007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.933932    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:24.935812 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.935780    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-dshm" (OuterVolumeSpecName: "dshm") pod "0493d294-6937-40b3-a065-be0ef18fc2ef" (UID: "0493d294-6937-40b3-a065-be0ef18fc2ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:53:24.935932 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.935838    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0493d294-6937-40b3-a065-be0ef18fc2ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0493d294-6937-40b3-a065-be0ef18fc2ef" (UID: "0493d294-6937-40b3-a065-be0ef18fc2ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:53:24.935932 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:24.935842    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0493d294-6937-40b3-a065-be0ef18fc2ef-kube-api-access-x7nwz" (OuterVolumeSpecName: "kube-api-access-x7nwz") pod "0493d294-6937-40b3-a065-be0ef18fc2ef" (UID: "0493d294-6937-40b3-a065-be0ef18fc2ef"). InnerVolumeSpecName "kube-api-access-x7nwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:53:25.034806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.034764    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0493d294-6937-40b3-a065-be0ef18fc2ef-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:25.034806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.034801    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7nwz\" (UniqueName: \"kubernetes.io/projected/0493d294-6937-40b3-a065-be0ef18fc2ef-kube-api-access-x7nwz\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:25.034806 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.034812    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0493d294-6937-40b3-a065-be0ef18fc2ef-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:25.340649 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.340580    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5" podUID="b6f1c145-cb53-485b-82b5-8cc2c1a13abe" containerName="main" containerID="cri-o://677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d" gracePeriod=45
Jul 23 12:53:25.599210 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.599145    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:53:25.681037 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.681004    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"
Jul 23 12:53:25.681240 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.681033    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr" event={"ID":"0493d294-6937-40b3-a065-be0ef18fc2ef","Type":"ContainerDied","Data":"399c8bfa1987aa92cd6802e938ba7d1235f36f7269f04a2915f7a5f4a9c6f434"}
Jul 23 12:53:25.681240 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.681090    2570 scope.go:117] "RemoveContainer" containerID="c4a6f3c1f1b2437a2b45b871cf535c3111d07d0b2173a26c16af84c914e0759a"
Jul 23 12:53:25.682449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.682430    2570 generic.go:356] "Generic (PLEG): container finished" podID="b6f1c145-cb53-485b-82b5-8cc2c1a13abe" containerID="677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d" exitCode=0
Jul 23 12:53:25.682566 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.682459    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5" event={"ID":"b6f1c145-cb53-485b-82b5-8cc2c1a13abe","Type":"ContainerDied","Data":"677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d"}
Jul 23 12:53:25.682566 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.682512    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5" event={"ID":"b6f1c145-cb53-485b-82b5-8cc2c1a13abe","Type":"ContainerDied","Data":"150a63a163bed79427f74d63ea2f9788eaddccc487cbede8d46d2c08cfcdb618"}
Jul 23 12:53:25.682566 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.682556    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"
Jul 23 12:53:25.690574 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.690542    2570 scope.go:117] "RemoveContainer" containerID="677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d"
Jul 23 12:53:25.698737 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.698712    2570 scope.go:117] "RemoveContainer" containerID="677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d"
Jul 23 12:53:25.698985 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:53:25.698964    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d\": container with ID starting with 677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d not found: ID does not exist" containerID="677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d"
Jul 23 12:53:25.699058 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.699005    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d"} err="failed to get container status \"677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d\": rpc error: code = NotFound desc = could not find container \"677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d\": container with ID starting with 677edfe339919d2a094f8dff56b99320f3e7a622bc97b6ab20b51a9d5df0be6d not found: ID does not exist"
Jul 23 12:53:25.707800 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.707774    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"]
Jul 23 12:53:25.712265 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.712242    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/auth-test-model-d45fc5-kserve-7ccf656855-n4bfr"]
Jul 23 12:53:25.742413 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.742385    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tls-certs\") pod \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") "
Jul 23 12:53:25.742664 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.742448    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-dshm\") pod \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") "
Jul 23 12:53:25.742664 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.742491    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tmp-dir\") pod \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") "
Jul 23 12:53:25.742664 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.742592    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stzgx\" (UniqueName: \"kubernetes.io/projected/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-kube-api-access-stzgx\") pod \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") "
Jul 23 12:53:25.742816 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.742682    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-home\") pod \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") "
Jul 23 12:53:25.742816 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.742712    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-model-cache\") pod \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\" (UID: \"b6f1c145-cb53-485b-82b5-8cc2c1a13abe\") "
Jul 23 12:53:25.742816 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.742740    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b6f1c145-cb53-485b-82b5-8cc2c1a13abe" (UID: "b6f1c145-cb53-485b-82b5-8cc2c1a13abe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:53:25.742977 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.742927    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-model-cache" (OuterVolumeSpecName: "model-cache") pod "b6f1c145-cb53-485b-82b5-8cc2c1a13abe" (UID: "b6f1c145-cb53-485b-82b5-8cc2c1a13abe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:53:25.742977 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.742963    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-home" (OuterVolumeSpecName: "home") pod "b6f1c145-cb53-485b-82b5-8cc2c1a13abe" (UID: "b6f1c145-cb53-485b-82b5-8cc2c1a13abe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:53:25.743170 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.743146    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:25.743170 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.743173    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:25.743318 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.743183    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:25.744850 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.744828    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-kube-api-access-stzgx" (OuterVolumeSpecName: "kube-api-access-stzgx") pod "b6f1c145-cb53-485b-82b5-8cc2c1a13abe" (UID: "b6f1c145-cb53-485b-82b5-8cc2c1a13abe"). InnerVolumeSpecName "kube-api-access-stzgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:53:25.745033 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.745009    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b6f1c145-cb53-485b-82b5-8cc2c1a13abe" (UID: "b6f1c145-cb53-485b-82b5-8cc2c1a13abe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:53:25.745113 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.745009    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-dshm" (OuterVolumeSpecName: "dshm") pod "b6f1c145-cb53-485b-82b5-8cc2c1a13abe" (UID: "b6f1c145-cb53-485b-82b5-8cc2c1a13abe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:53:25.844626 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.844574    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:25.844626 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.844627    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:25.844850 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:25.844639    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stzgx\" (UniqueName: \"kubernetes.io/projected/b6f1c145-cb53-485b-82b5-8cc2c1a13abe-kube-api-access-stzgx\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:53:26.008041 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:26.008002    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"]
Jul 23 12:53:26.010631 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:26.010603    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/auth-test-model-474ecb-kserve-75fd57777f-h4gt5"]
Jul 23 12:53:26.739295 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:26.739260    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0493d294-6937-40b3-a065-be0ef18fc2ef" path="/var/lib/kubelet/pods/0493d294-6937-40b3-a065-be0ef18fc2ef/volumes"
Jul 23 12:53:26.739887 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:26.739857    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f1c145-cb53-485b-82b5-8cc2c1a13abe" path="/var/lib/kubelet/pods/b6f1c145-cb53-485b-82b5-8cc2c1a13abe/volumes"
Jul 23 12:53:31.409140 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.409100    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"]
Jul 23 12:53:31.409540 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.409462    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0493d294-6937-40b3-a065-be0ef18fc2ef" containerName="main"
Jul 23 12:53:31.409540 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.409494    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0493d294-6937-40b3-a065-be0ef18fc2ef" containerName="main"
Jul 23 12:53:31.409540 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.409508    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f1c145-cb53-485b-82b5-8cc2c1a13abe" containerName="main"
Jul 23 12:53:31.409540 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.409514    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f1c145-cb53-485b-82b5-8cc2c1a13abe" containerName="main"
Jul 23 12:53:31.409671 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.409576    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0493d294-6937-40b3-a065-be0ef18fc2ef" containerName="main"
Jul 23 12:53:31.409671 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.409585    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f1c145-cb53-485b-82b5-8cc2c1a13abe" containerName="main"
Jul 23 12:53:31.414179 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.414160    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.417849 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.417823    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d45fc5\"/\"openshift-service-ca.crt\""
Jul 23 12:53:31.418016 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.417859    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d45fc5\"/\"default-dockercfg-sdwcm\""
Jul 23 12:53:31.418016 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.417882    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d45fc5\"/\"kube-root-ca.crt\""
Jul 23 12:53:31.418016 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.417864    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d45fc5\"/\"sub-test-model-d45fc5-kserve-self-signed-certs\""
Jul 23 12:53:31.423587 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.423556    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"]
Jul 23 12:53:31.438809 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.438778    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:53:31.488130 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.488093    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-model-cache\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.488130 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.488134    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-home\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.488365 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.488239    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f92b0289-253a-4e8f-88c3-641c0ca7b061-tls-certs\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.488365 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.488324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-dshm\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.488365 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.488345    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx7vd\" (UniqueName: \"kubernetes.io/projected/f92b0289-253a-4e8f-88c3-641c0ca7b061-kube-api-access-gx7vd\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.488365 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.488363    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-tmp-dir\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.589493 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.589436    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-model-cache\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.589714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.589511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-home\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.589714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.589566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f92b0289-253a-4e8f-88c3-641c0ca7b061-tls-certs\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.589714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.589635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-dshm\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.589714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.589661    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx7vd\" (UniqueName: \"kubernetes.io/projected/f92b0289-253a-4e8f-88c3-641c0ca7b061-kube-api-access-gx7vd\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.589714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.589684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-tmp-dir\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.590056 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.589964    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-model-cache\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.590268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.590237    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-home\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.590722 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.590692    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-tmp-dir\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.592978 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.592949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-dshm\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.593210 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.593191    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f92b0289-253a-4e8f-88c3-641c0ca7b061-tls-certs\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.601212 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.601183    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx7vd\" (UniqueName: \"kubernetes.io/projected/f92b0289-253a-4e8f-88c3-641c0ca7b061-kube-api-access-gx7vd\") pod \"sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") " pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.725773 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.725736    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:31.878199 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:31.878168    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"]
Jul 23 12:53:31.880845 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:53:31.880813    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf92b0289_253a_4e8f_88c3_641c0ca7b061.slice/crio-77fbe61251f1e386d0d04f3dcfc4a6f5c502798e9a7c07362ccde179d66042bd WatchSource:0}: Error finding container 77fbe61251f1e386d0d04f3dcfc4a6f5c502798e9a7c07362ccde179d66042bd: Status 404 returned error can't find the container with id 77fbe61251f1e386d0d04f3dcfc4a6f5c502798e9a7c07362ccde179d66042bd
Jul 23 12:53:32.722922 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:32.722882    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k" event={"ID":"f92b0289-253a-4e8f-88c3-641c0ca7b061","Type":"ContainerStarted","Data":"57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017"}
Jul 23 12:53:32.722922 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:32.722927    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k" event={"ID":"f92b0289-253a-4e8f-88c3-641c0ca7b061","Type":"ContainerStarted","Data":"77fbe61251f1e386d0d04f3dcfc4a6f5c502798e9a7c07362ccde179d66042bd"}
Jul 23 12:53:32.756421 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:32.756367    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k" podStartSLOduration=1.756351931 podStartE2EDuration="1.756351931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:53:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:53:32.754316664 +0000 UTC m=+2614.515436033" watchObservedRunningTime="2026-07-23 12:53:32.756351931 +0000 UTC m=+2614.517471281"
Jul 23 12:53:41.726765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:41.726724    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:41.727232 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:41.726785    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:41.739572 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:41.739540    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:41.785481 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:41.785433    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:53:54.642089 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:53:54.642055    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:54:15.600673 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.600633    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"]
Jul 23 12:54:15.604340 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.604314    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.607765 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.607733    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"sub-test-model-474ecb-kserve-self-signed-certs\""
Jul 23 12:54:15.607925 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.607733    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"openshift-service-ca.crt\""
Jul 23 12:54:15.607925 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.607734    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"default-dockercfg-kt5hf\""
Jul 23 12:54:15.607925 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.607745    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"kube-root-ca.crt\""
Jul 23 12:54:15.614410 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.614382    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"]
Jul 23 12:54:15.618335 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.618302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:54:15.710235 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.710192    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/587d2157-f993-4049-b72f-92bd76f64d70-tls-certs\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.710235 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.710236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg5dw\" (UniqueName: \"kubernetes.io/projected/587d2157-f993-4049-b72f-92bd76f64d70-kube-api-access-dg5dw\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.710506 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.710330    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-dshm\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.710506 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.710363    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-model-cache\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.710506 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.710381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-tmp-dir\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.710506 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.710402    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-home\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.811876 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.811834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-dshm\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.811876 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.811880    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-model-cache\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.812112 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.811901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-tmp-dir\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.812112 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.811923    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-home\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.812112 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.811988    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/587d2157-f993-4049-b72f-92bd76f64d70-tls-certs\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.812112 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.812015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg5dw\" (UniqueName: \"kubernetes.io/projected/587d2157-f993-4049-b72f-92bd76f64d70-kube-api-access-dg5dw\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.812420 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.812391    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-tmp-dir\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.812586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.812425    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-home\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.812586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.812444    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-model-cache\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.814369 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.814342    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-dshm\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.814554 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.814537    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/587d2157-f993-4049-b72f-92bd76f64d70-tls-certs\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.820948 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.820917    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg5dw\" (UniqueName: \"kubernetes.io/projected/587d2157-f993-4049-b72f-92bd76f64d70-kube-api-access-dg5dw\") pod \"sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") " pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:15.916193 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:15.916101    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:16.063744 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:16.063706    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"]
Jul 23 12:54:16.067455 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:54:16.067427    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod587d2157_f993_4049_b72f_92bd76f64d70.slice/crio-c4db67ad8670ec8a69b3c586425b380b9cee261ce28d7aea2b56398015101161 WatchSource:0}: Error finding container c4db67ad8670ec8a69b3c586425b380b9cee261ce28d7aea2b56398015101161: Status 404 returned error can't find the container with id c4db67ad8670ec8a69b3c586425b380b9cee261ce28d7aea2b56398015101161
Jul 23 12:54:16.975247 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:16.975204    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz" event={"ID":"587d2157-f993-4049-b72f-92bd76f64d70","Type":"ContainerStarted","Data":"0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6"}
Jul 23 12:54:16.975778 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:16.975290    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz" event={"ID":"587d2157-f993-4049-b72f-92bd76f64d70","Type":"ContainerStarted","Data":"c4db67ad8670ec8a69b3c586425b380b9cee261ce28d7aea2b56398015101161"}
Jul 23 12:54:16.995775 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:16.995711    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz" podStartSLOduration=1.995690621 podStartE2EDuration="1.995690621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:54:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:54:16.99302819 +0000 UTC m=+2658.754147543" watchObservedRunningTime="2026-07-23 12:54:16.995690621 +0000 UTC m=+2658.756809972"
Jul 23 12:54:25.917022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:25.916981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:25.917022 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:25.917030    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:25.929808 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:25.929770    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:26.036255 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:26.036220    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:54:49.864043 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:49.864011    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:54:50.375288 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:50.375251    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"]
Jul 23 12:54:50.441813 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:50.441775    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:54:51.214419 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:51.214333    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"]
Jul 23 12:54:51.236434 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:51.236396    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:54:58.883120 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:58.883090    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:54:58.886093 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:58.886068    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:54:59.083010 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.082960    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"]
Jul 23 12:54:59.088428 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.088393    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.091877 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.091843    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d45fc5\"/\"rate-test-model-d45fc5-kserve-self-signed-certs\""
Jul 23 12:54:59.094936 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.094908    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"]
Jul 23 12:54:59.144076 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.143963    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74ch\" (UniqueName: \"kubernetes.io/projected/18659b9f-7908-47f9-ad48-51d2607d757d-kube-api-access-x74ch\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.144076 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.144023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-tmp-dir\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.144329 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.144089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-model-cache\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.144329 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.144115    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-dshm\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.144329 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.144160    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18659b9f-7908-47f9-ad48-51d2607d757d-tls-certs\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.144329 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.144224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-home\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.245640 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.245593    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-model-cache\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.245640 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.245647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-dshm\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.245872 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.245702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18659b9f-7908-47f9-ad48-51d2607d757d-tls-certs\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.245872 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.245734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-home\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.245872 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.245834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x74ch\" (UniqueName: \"kubernetes.io/projected/18659b9f-7908-47f9-ad48-51d2607d757d-kube-api-access-x74ch\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.245990 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.245886    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-tmp-dir\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.246102 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.246081    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-model-cache\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.246189 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.246161    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-home\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.246243 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.246190    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-tmp-dir\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.248387 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.248355    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-dshm\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.248724 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.248706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18659b9f-7908-47f9-ad48-51d2607d757d-tls-certs\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.258430 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.258385    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74ch\" (UniqueName: \"kubernetes.io/projected/18659b9f-7908-47f9-ad48-51d2607d757d-kube-api-access-x74ch\") pod \"rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") " pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.285461 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.285426    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:54:59.400719 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.400611    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:54:59.548316 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:54:59.548283    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"]
Jul 23 12:54:59.549447 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:54:59.549423    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18659b9f_7908_47f9_ad48_51d2607d757d.slice/crio-6efbf45694ad30d03214d2b25eebff922d51749726aeac11655439546c2a754e WatchSource:0}: Error finding container 6efbf45694ad30d03214d2b25eebff922d51749726aeac11655439546c2a754e: Status 404 returned error can't find the container with id 6efbf45694ad30d03214d2b25eebff922d51749726aeac11655439546c2a754e
Jul 23 12:55:00.226065 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:00.226023    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh" event={"ID":"18659b9f-7908-47f9-ad48-51d2607d757d","Type":"ContainerStarted","Data":"6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd"}
Jul 23 12:55:00.226529 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:00.226075    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh" event={"ID":"18659b9f-7908-47f9-ad48-51d2607d757d","Type":"ContainerStarted","Data":"6efbf45694ad30d03214d2b25eebff922d51749726aeac11655439546c2a754e"}
Jul 23 12:55:00.245126 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:00.245063    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh" podStartSLOduration=1.245046455 podStartE2EDuration="1.245046455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:55:00.24279795 +0000 UTC m=+2702.003917302" watchObservedRunningTime="2026-07-23 12:55:00.245046455 +0000 UTC m=+2702.006165806"
Jul 23 12:55:01.516494 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:01.516422    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:55:01.615744 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:01.615686    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:55:05.397552 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.397508    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k" podUID="f92b0289-253a-4e8f-88c3-641c0ca7b061" containerName="main" containerID="cri-o://57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017" gracePeriod=45
Jul 23 12:55:05.657344 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.657266    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:55:05.709158 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709124    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-home\") pod \"f92b0289-253a-4e8f-88c3-641c0ca7b061\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") "
Jul 23 12:55:05.709367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709186    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx7vd\" (UniqueName: \"kubernetes.io/projected/f92b0289-253a-4e8f-88c3-641c0ca7b061-kube-api-access-gx7vd\") pod \"f92b0289-253a-4e8f-88c3-641c0ca7b061\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") "
Jul 23 12:55:05.709367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709218    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-dshm\") pod \"f92b0289-253a-4e8f-88c3-641c0ca7b061\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") "
Jul 23 12:55:05.709367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709243    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-tmp-dir\") pod \"f92b0289-253a-4e8f-88c3-641c0ca7b061\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") "
Jul 23 12:55:05.709367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709328    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-model-cache\") pod \"f92b0289-253a-4e8f-88c3-641c0ca7b061\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") "
Jul 23 12:55:05.709367 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709354    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f92b0289-253a-4e8f-88c3-641c0ca7b061-tls-certs\") pod \"f92b0289-253a-4e8f-88c3-641c0ca7b061\" (UID: \"f92b0289-253a-4e8f-88c3-641c0ca7b061\") "
Jul 23 12:55:05.709687 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709414    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-home" (OuterVolumeSpecName: "home") pod "f92b0289-253a-4e8f-88c3-641c0ca7b061" (UID: "f92b0289-253a-4e8f-88c3-641c0ca7b061"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:55:05.709687 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709623    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f92b0289-253a-4e8f-88c3-641c0ca7b061" (UID: "f92b0289-253a-4e8f-88c3-641c0ca7b061"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:55:05.709687 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709631    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-model-cache" (OuterVolumeSpecName: "model-cache") pod "f92b0289-253a-4e8f-88c3-641c0ca7b061" (UID: "f92b0289-253a-4e8f-88c3-641c0ca7b061"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:55:05.709796 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709762    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:05.709796 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709780    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:05.709796 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.709791    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:05.711434 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.711415    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-dshm" (OuterVolumeSpecName: "dshm") pod "f92b0289-253a-4e8f-88c3-641c0ca7b061" (UID: "f92b0289-253a-4e8f-88c3-641c0ca7b061"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:55:05.711525 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.711413    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92b0289-253a-4e8f-88c3-641c0ca7b061-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f92b0289-253a-4e8f-88c3-641c0ca7b061" (UID: "f92b0289-253a-4e8f-88c3-641c0ca7b061"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:55:05.711584 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.711549    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92b0289-253a-4e8f-88c3-641c0ca7b061-kube-api-access-gx7vd" (OuterVolumeSpecName: "kube-api-access-gx7vd") pod "f92b0289-253a-4e8f-88c3-641c0ca7b061" (UID: "f92b0289-253a-4e8f-88c3-641c0ca7b061"). InnerVolumeSpecName "kube-api-access-gx7vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:55:05.810906 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.810861    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx7vd\" (UniqueName: \"kubernetes.io/projected/f92b0289-253a-4e8f-88c3-641c0ca7b061-kube-api-access-gx7vd\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:05.810906 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.810900    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f92b0289-253a-4e8f-88c3-641c0ca7b061-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:05.810906 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:05.810915    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f92b0289-253a-4e8f-88c3-641c0ca7b061-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:06.234938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.234890    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz" podUID="587d2157-f993-4049-b72f-92bd76f64d70" containerName="main" containerID="cri-o://0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6" gracePeriod=45
Jul 23 12:55:06.265697 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.265657    2570 generic.go:356] "Generic (PLEG): container finished" podID="f92b0289-253a-4e8f-88c3-641c0ca7b061" containerID="57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017" exitCode=0
Jul 23 12:55:06.265901 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.265716    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"
Jul 23 12:55:06.265901 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.265722    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k" event={"ID":"f92b0289-253a-4e8f-88c3-641c0ca7b061","Type":"ContainerDied","Data":"57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017"}
Jul 23 12:55:06.265901 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.265836    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k" event={"ID":"f92b0289-253a-4e8f-88c3-641c0ca7b061","Type":"ContainerDied","Data":"77fbe61251f1e386d0d04f3dcfc4a6f5c502798e9a7c07362ccde179d66042bd"}
Jul 23 12:55:06.265901 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.265859    2570 scope.go:117] "RemoveContainer" containerID="57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017"
Jul 23 12:55:06.305293 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.305258    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"]
Jul 23 12:55:06.309465 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.309434    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/sub-test-model-d45fc5-kserve-85b8f7c47c-rfw4k"]
Jul 23 12:55:06.347353 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.347330    2570 scope.go:117] "RemoveContainer" containerID="57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017"
Jul 23 12:55:06.347724 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:55:06.347695    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017\": container with ID starting with 57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017 not found: ID does not exist" containerID="57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017"
Jul 23 12:55:06.347793 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.347735    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017"} err="failed to get container status \"57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017\": rpc error: code = NotFound desc = could not find container \"57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017\": container with ID starting with 57c5978360b8ed0451fde16c96e13f2189855e21e2f2d6e608bf1e2cb22e9017 not found: ID does not exist"
Jul 23 12:55:06.498944 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.498868    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:55:06.618714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.618676    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg5dw\" (UniqueName: \"kubernetes.io/projected/587d2157-f993-4049-b72f-92bd76f64d70-kube-api-access-dg5dw\") pod \"587d2157-f993-4049-b72f-92bd76f64d70\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") "
Jul 23 12:55:06.618714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.618717    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-dshm\") pod \"587d2157-f993-4049-b72f-92bd76f64d70\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") "
Jul 23 12:55:06.618974 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.618737    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-tmp-dir\") pod \"587d2157-f993-4049-b72f-92bd76f64d70\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") "
Jul 23 12:55:06.618974 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.618772    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-model-cache\") pod \"587d2157-f993-4049-b72f-92bd76f64d70\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") "
Jul 23 12:55:06.618974 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.618800    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-home\") pod \"587d2157-f993-4049-b72f-92bd76f64d70\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") "
Jul 23 12:55:06.618974 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.618836    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/587d2157-f993-4049-b72f-92bd76f64d70-tls-certs\") pod \"587d2157-f993-4049-b72f-92bd76f64d70\" (UID: \"587d2157-f993-4049-b72f-92bd76f64d70\") "
Jul 23 12:55:06.619186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.619093    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-model-cache" (OuterVolumeSpecName: "model-cache") pod "587d2157-f993-4049-b72f-92bd76f64d70" (UID: "587d2157-f993-4049-b72f-92bd76f64d70"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:55:06.619186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.619117    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "587d2157-f993-4049-b72f-92bd76f64d70" (UID: "587d2157-f993-4049-b72f-92bd76f64d70"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:55:06.619186 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.619105    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-home" (OuterVolumeSpecName: "home") pod "587d2157-f993-4049-b72f-92bd76f64d70" (UID: "587d2157-f993-4049-b72f-92bd76f64d70"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:55:06.621007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.620981    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-dshm" (OuterVolumeSpecName: "dshm") pod "587d2157-f993-4049-b72f-92bd76f64d70" (UID: "587d2157-f993-4049-b72f-92bd76f64d70"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:55:06.621118 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.620976    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/587d2157-f993-4049-b72f-92bd76f64d70-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "587d2157-f993-4049-b72f-92bd76f64d70" (UID: "587d2157-f993-4049-b72f-92bd76f64d70"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:55:06.621118 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.621012    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/587d2157-f993-4049-b72f-92bd76f64d70-kube-api-access-dg5dw" (OuterVolumeSpecName: "kube-api-access-dg5dw") pod "587d2157-f993-4049-b72f-92bd76f64d70" (UID: "587d2157-f993-4049-b72f-92bd76f64d70"). InnerVolumeSpecName "kube-api-access-dg5dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:55:06.720344 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.720303    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:06.720344 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.720339    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:06.720344 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.720348    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/587d2157-f993-4049-b72f-92bd76f64d70-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:06.720618 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.720360    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg5dw\" (UniqueName: \"kubernetes.io/projected/587d2157-f993-4049-b72f-92bd76f64d70-kube-api-access-dg5dw\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:06.720618 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.720368    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:06.720618 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.720399    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/587d2157-f993-4049-b72f-92bd76f64d70-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:55:06.738609 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:06.738575    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92b0289-253a-4e8f-88c3-641c0ca7b061" path="/var/lib/kubelet/pods/f92b0289-253a-4e8f-88c3-641c0ca7b061/volumes"
Jul 23 12:55:07.274418 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:07.274382    2570 generic.go:356] "Generic (PLEG): container finished" podID="587d2157-f993-4049-b72f-92bd76f64d70" containerID="0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6" exitCode=0
Jul 23 12:55:07.274634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:07.274433    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"
Jul 23 12:55:07.274634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:07.274440    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz" event={"ID":"587d2157-f993-4049-b72f-92bd76f64d70","Type":"ContainerDied","Data":"0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6"}
Jul 23 12:55:07.274634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:07.274497    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz" event={"ID":"587d2157-f993-4049-b72f-92bd76f64d70","Type":"ContainerDied","Data":"c4db67ad8670ec8a69b3c586425b380b9cee261ce28d7aea2b56398015101161"}
Jul 23 12:55:07.274634 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:07.274514    2570 scope.go:117] "RemoveContainer" containerID="0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6"
Jul 23 12:55:07.283943 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:07.283924    2570 scope.go:117] "RemoveContainer" containerID="0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6"
Jul 23 12:55:07.284252 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:55:07.284227    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6\": container with ID starting with 0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6 not found: ID does not exist" containerID="0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6"
Jul 23 12:55:07.284297 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:07.284259    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6"} err="failed to get container status \"0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6\": rpc error: code = NotFound desc = could not find container \"0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6\": container with ID starting with 0d2c89c77bc79734cae44c743f2585f8fb4182eeffd941894c20a9ef826f42f6 not found: ID does not exist"
Jul 23 12:55:07.292213 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:07.292179    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"]
Jul 23 12:55:07.296063 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:07.296030    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/sub-test-model-474ecb-kserve-7ccc8c6957-mpsbz"]
Jul 23 12:55:08.738918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:08.738889    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="587d2157-f993-4049-b72f-92bd76f64d70" path="/var/lib/kubelet/pods/587d2157-f993-4049-b72f-92bd76f64d70/volumes"
Jul 23 12:55:09.401543 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:09.401499    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:55:09.401802 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:09.401781    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:55:09.414487 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:09.414445    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:55:10.307132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:10.307092    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:55:23.803751 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.803711    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"]
Jul 23 12:55:23.804149 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.804091    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92b0289-253a-4e8f-88c3-641c0ca7b061" containerName="main"
Jul 23 12:55:23.804149 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.804102    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92b0289-253a-4e8f-88c3-641c0ca7b061" containerName="main"
Jul 23 12:55:23.804149 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.804110    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="587d2157-f993-4049-b72f-92bd76f64d70" containerName="main"
Jul 23 12:55:23.804149 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.804115    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="587d2157-f993-4049-b72f-92bd76f64d70" containerName="main"
Jul 23 12:55:23.804282 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.804181    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="587d2157-f993-4049-b72f-92bd76f64d70" containerName="main"
Jul 23 12:55:23.804282 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.804190    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92b0289-253a-4e8f-88c3-641c0ca7b061" containerName="main"
Jul 23 12:55:23.808584 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.808560    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:23.812144 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.812090    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"default-dockercfg-kt5hf\""
Jul 23 12:55:23.812144 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.812108    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"openshift-service-ca.crt\""
Jul 23 12:55:23.812144 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.812134    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"rate-test-model-474ecb-kserve-self-signed-certs\""
Jul 23 12:55:23.812504 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.812090    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-474ecb\"/\"kube-root-ca.crt\""
Jul 23 12:55:23.815546 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.815521    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"]
Jul 23 12:55:23.897567 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.897518    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:55:23.994744 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.994702    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-home\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:23.994947 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.994765    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tmp-dir\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:23.994947 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.994827    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-model-cache\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:23.994947 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.994908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tls-certs\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:23.994947 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.994941    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-dshm\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:23.995112 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:23.994978    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xczmr\" (UniqueName: \"kubernetes.io/projected/c368f202-99e3-419a-9edb-a9fa6f75dbd1-kube-api-access-xczmr\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.096161 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.096057    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-dshm\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.096161 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.096115    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xczmr\" (UniqueName: \"kubernetes.io/projected/c368f202-99e3-419a-9edb-a9fa6f75dbd1-kube-api-access-xczmr\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.096161 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.096163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-home\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.096509 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.096198    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tmp-dir\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.096509 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.096218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-model-cache\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.096509 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.096345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tls-certs\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.096687 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.096636    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-home\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.096726 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.096696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-model-cache\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.096905 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.096880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tmp-dir\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.098578 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.098560    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-dshm\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.098984 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.098964    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tls-certs\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.106498 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.106450    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xczmr\" (UniqueName: \"kubernetes.io/projected/c368f202-99e3-419a-9edb-a9fa6f75dbd1-kube-api-access-xczmr\") pod \"rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") " pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.119227 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.119192    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:24.261119 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.261088    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"]
Jul 23 12:55:24.263149 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:55:24.263120    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc368f202_99e3_419a_9edb_a9fa6f75dbd1.slice/crio-4eb0c2e754bb3710dd5b8b2b8fa5951ba251aeeab7cf6238c0f873f1b7544507 WatchSource:0}: Error finding container 4eb0c2e754bb3710dd5b8b2b8fa5951ba251aeeab7cf6238c0f873f1b7544507: Status 404 returned error can't find the container with id 4eb0c2e754bb3710dd5b8b2b8fa5951ba251aeeab7cf6238c0f873f1b7544507
Jul 23 12:55:24.373193 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.373095    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q" event={"ID":"c368f202-99e3-419a-9edb-a9fa6f75dbd1","Type":"ContainerStarted","Data":"9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b"}
Jul 23 12:55:24.373193 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.373142    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q" event={"ID":"c368f202-99e3-419a-9edb-a9fa6f75dbd1","Type":"ContainerStarted","Data":"4eb0c2e754bb3710dd5b8b2b8fa5951ba251aeeab7cf6238c0f873f1b7544507"}
Jul 23 12:55:24.392261 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:24.392191    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q" podStartSLOduration=1.392167731 podStartE2EDuration="1.392167731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:55:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:55:24.389320151 +0000 UTC m=+2726.150439529" watchObservedRunningTime="2026-07-23 12:55:24.392167731 +0000 UTC m=+2726.153287135"
Jul 23 12:55:34.120416 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:34.120365    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:34.120416 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:34.120425    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:34.133522 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:34.133458    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:34.440181 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:34.440087    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:55:38.453120 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:38.453080    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:55:38.552344 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:38.552299    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:55:47.050694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:47.050660    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:55:47.150617 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:55:47.150582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:03.730396 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:03.730355    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"]
Jul 23 12:56:03.748749 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:03.748709    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:04.688179 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:04.688143    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"]
Jul 23 12:56:04.700688 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:04.700654    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:09.081532 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.081492    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7583-140481949801904"]
Jul 23 12:56:09.085015 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.084996    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949801904"
Jul 23 12:56:09.087890 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.087857    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-srl6f\""
Jul 23 12:56:09.090859 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.090828    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7583-140481949801904"]
Jul 23 12:56:09.151157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.151119    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjk8x\" (UniqueName: \"kubernetes.io/projected/e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4-kube-api-access-hjk8x\") pod \"test-curl-7583-140481949801904\" (UID: \"e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4\") " pod="opendatahub/test-curl-7583-140481949801904"
Jul 23 12:56:09.252357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.252306    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjk8x\" (UniqueName: \"kubernetes.io/projected/e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4-kube-api-access-hjk8x\") pod \"test-curl-7583-140481949801904\" (UID: \"e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4\") " pod="opendatahub/test-curl-7583-140481949801904"
Jul 23 12:56:09.261843 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.261803    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjk8x\" (UniqueName: \"kubernetes.io/projected/e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4-kube-api-access-hjk8x\") pod \"test-curl-7583-140481949801904\" (UID: \"e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4\") " pod="opendatahub/test-curl-7583-140481949801904"
Jul 23 12:56:09.396584 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.396493    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949801904"
Jul 23 12:56:09.544080 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.544047    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7583-140481949801904"]
Jul 23 12:56:09.545757 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:56:09.545732    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8deeeef_5d54_4c8c_b6cb_0c41cdf262c4.slice/crio-e312cad25565c9f100bb80aa25faebd72819bc95b891da81d1eadbd0fd6b53cf WatchSource:0}: Error finding container e312cad25565c9f100bb80aa25faebd72819bc95b891da81d1eadbd0fd6b53cf: Status 404 returned error can't find the container with id e312cad25565c9f100bb80aa25faebd72819bc95b891da81d1eadbd0fd6b53cf
Jul 23 12:56:09.547306 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.547285    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 12:56:09.642494 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:09.642434    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7583-140481949801904" event={"ID":"e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4","Type":"ContainerStarted","Data":"e312cad25565c9f100bb80aa25faebd72819bc95b891da81d1eadbd0fd6b53cf"}
Jul 23 12:56:10.649339 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:10.649245    2570 generic.go:356] "Generic (PLEG): container finished" podID="e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4" containerID="ab38a77721f64af0ee0eb6a9853c91649927dea553f5775b9337ecbb2dc157a3" exitCode=0
Jul 23 12:56:10.649730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:10.649333    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7583-140481949801904" event={"ID":"e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4","Type":"ContainerDied","Data":"ab38a77721f64af0ee0eb6a9853c91649927dea553f5775b9337ecbb2dc157a3"}
Jul 23 12:56:11.796104 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:11.796070    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949801904"
Jul 23 12:56:11.819886 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:11.819858    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7583-140481949801904_e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4/test-curl-7583-140481949801904/0.log"
Jul 23 12:56:11.847403 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:11.847368    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7583-140481949801904"]
Jul 23 12:56:11.849722 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:11.849697    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7583-140481949801904"]
Jul 23 12:56:11.879090 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:11.879055    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjk8x\" (UniqueName: \"kubernetes.io/projected/e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4-kube-api-access-hjk8x\") pod \"e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4\" (UID: \"e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4\") "
Jul 23 12:56:11.881387 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:11.881343    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4-kube-api-access-hjk8x" (OuterVolumeSpecName: "kube-api-access-hjk8x") pod "e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4" (UID: "e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4"). InnerVolumeSpecName "kube-api-access-hjk8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:56:11.928539 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:11.928415    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:11.980382 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:11.980343    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjk8x\" (UniqueName: \"kubernetes.io/projected/e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4-kube-api-access-hjk8x\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:12.661320 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:12.661286    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949801904"
Jul 23 12:56:12.661533 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:12.661300    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e312cad25565c9f100bb80aa25faebd72819bc95b891da81d1eadbd0fd6b53cf"
Jul 23 12:56:12.671557 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:56:12.671515    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7583-140481949801904\" is forbidden: User \"system:node:ip-10-0-133-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-105.ec2.internal' and this object" podUID="e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4" pod="opendatahub/test-curl-7583-140481949801904"
Jul 23 12:56:12.738878 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:12.738849    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4" path="/var/lib/kubelet/pods/e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4/volumes"
Jul 23 12:56:18.110372 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.110335    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:18.110797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.110724    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4" containerName="test-curl-7583-140481949801904"
Jul 23 12:56:18.110797 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.110738    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4" containerName="test-curl-7583-140481949801904"
Jul 23 12:56:18.110870 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.110818    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8deeeef-5d54-4c8c-b6cb-0c41cdf262c4" containerName="test-curl-7583-140481949801904"
Jul 23 12:56:18.114141 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.114125    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:18.117037 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.116969    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-srl6f\""
Jul 23 12:56:18.118421 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.118396    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:18.241865 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.241829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwqlv\" (UniqueName: \"kubernetes.io/projected/e7ebedfb-099f-4f60-97c5-cf0fa406e970-kube-api-access-vwqlv\") pod \"test-curl-7583-140481949653008\" (UID: \"e7ebedfb-099f-4f60-97c5-cf0fa406e970\") " pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:18.343458 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.343408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwqlv\" (UniqueName: \"kubernetes.io/projected/e7ebedfb-099f-4f60-97c5-cf0fa406e970-kube-api-access-vwqlv\") pod \"test-curl-7583-140481949653008\" (UID: \"e7ebedfb-099f-4f60-97c5-cf0fa406e970\") " pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:18.353152 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.353116    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwqlv\" (UniqueName: \"kubernetes.io/projected/e7ebedfb-099f-4f60-97c5-cf0fa406e970-kube-api-access-vwqlv\") pod \"test-curl-7583-140481949653008\" (UID: \"e7ebedfb-099f-4f60-97c5-cf0fa406e970\") " pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:18.426061 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.425971    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:18.566122 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.566084    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:18.567460 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:56:18.567431    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7ebedfb_099f_4f60_97c5_cf0fa406e970.slice/crio-04b14bb403a35b329a2d843dc8a305f0350e387c40e1e988b452ca3d196f388f WatchSource:0}: Error finding container 04b14bb403a35b329a2d843dc8a305f0350e387c40e1e988b452ca3d196f388f: Status 404 returned error can't find the container with id 04b14bb403a35b329a2d843dc8a305f0350e387c40e1e988b452ca3d196f388f
Jul 23 12:56:18.699053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.698950    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7583-140481949653008" event={"ID":"e7ebedfb-099f-4f60-97c5-cf0fa406e970","Type":"ContainerStarted","Data":"04b14bb403a35b329a2d843dc8a305f0350e387c40e1e988b452ca3d196f388f"}
Jul 23 12:56:18.751863 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.751818    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh" podUID="18659b9f-7908-47f9-ad48-51d2607d757d" containerName="main" containerID="cri-o://6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd" gracePeriod=45
Jul 23 12:56:18.992258 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:18.992229    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:56:19.050976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.050933    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-model-cache\") pod \"18659b9f-7908-47f9-ad48-51d2607d757d\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") "
Jul 23 12:56:19.051188 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051057    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-tmp-dir\") pod \"18659b9f-7908-47f9-ad48-51d2607d757d\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") "
Jul 23 12:56:19.051188 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051120    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x74ch\" (UniqueName: \"kubernetes.io/projected/18659b9f-7908-47f9-ad48-51d2607d757d-kube-api-access-x74ch\") pod \"18659b9f-7908-47f9-ad48-51d2607d757d\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") "
Jul 23 12:56:19.051188 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051148    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-dshm\") pod \"18659b9f-7908-47f9-ad48-51d2607d757d\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") "
Jul 23 12:56:19.051188 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051172    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-home\") pod \"18659b9f-7908-47f9-ad48-51d2607d757d\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") "
Jul 23 12:56:19.051406 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051230    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18659b9f-7908-47f9-ad48-51d2607d757d-tls-certs\") pod \"18659b9f-7908-47f9-ad48-51d2607d757d\" (UID: \"18659b9f-7908-47f9-ad48-51d2607d757d\") "
Jul 23 12:56:19.051406 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051299    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-model-cache" (OuterVolumeSpecName: "model-cache") pod "18659b9f-7908-47f9-ad48-51d2607d757d" (UID: "18659b9f-7908-47f9-ad48-51d2607d757d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:56:19.051406 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051313    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "18659b9f-7908-47f9-ad48-51d2607d757d" (UID: "18659b9f-7908-47f9-ad48-51d2607d757d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:56:19.051598 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051518    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-home" (OuterVolumeSpecName: "home") pod "18659b9f-7908-47f9-ad48-51d2607d757d" (UID: "18659b9f-7908-47f9-ad48-51d2607d757d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:56:19.051686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051664    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:19.051736 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051694    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:19.051736 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.051710    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:19.053374 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.053350    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18659b9f-7908-47f9-ad48-51d2607d757d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "18659b9f-7908-47f9-ad48-51d2607d757d" (UID: "18659b9f-7908-47f9-ad48-51d2607d757d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:56:19.053511 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.053383    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-dshm" (OuterVolumeSpecName: "dshm") pod "18659b9f-7908-47f9-ad48-51d2607d757d" (UID: "18659b9f-7908-47f9-ad48-51d2607d757d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:56:19.053511 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.053395    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18659b9f-7908-47f9-ad48-51d2607d757d-kube-api-access-x74ch" (OuterVolumeSpecName: "kube-api-access-x74ch") pod "18659b9f-7908-47f9-ad48-51d2607d757d" (UID: "18659b9f-7908-47f9-ad48-51d2607d757d"). InnerVolumeSpecName "kube-api-access-x74ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:56:19.152443 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.152407    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x74ch\" (UniqueName: \"kubernetes.io/projected/18659b9f-7908-47f9-ad48-51d2607d757d-kube-api-access-x74ch\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:19.152443 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.152438    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18659b9f-7908-47f9-ad48-51d2607d757d-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:19.152443 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.152448    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18659b9f-7908-47f9-ad48-51d2607d757d-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:19.706094 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.706001    2570 generic.go:356] "Generic (PLEG): container finished" podID="e7ebedfb-099f-4f60-97c5-cf0fa406e970" containerID="be54cb4e0ada94d610f3f6127ae399f69058e841769e96a3e9fbe3617ac0c93a" exitCode=0
Jul 23 12:56:19.706270 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.706122    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7583-140481949653008" event={"ID":"e7ebedfb-099f-4f60-97c5-cf0fa406e970","Type":"ContainerDied","Data":"be54cb4e0ada94d610f3f6127ae399f69058e841769e96a3e9fbe3617ac0c93a"}
Jul 23 12:56:19.707435 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.707405    2570 generic.go:356] "Generic (PLEG): container finished" podID="18659b9f-7908-47f9-ad48-51d2607d757d" containerID="6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd" exitCode=0
Jul 23 12:56:19.707577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.707445    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"
Jul 23 12:56:19.707577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.707497    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh" event={"ID":"18659b9f-7908-47f9-ad48-51d2607d757d","Type":"ContainerDied","Data":"6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd"}
Jul 23 12:56:19.707577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.707533    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh" event={"ID":"18659b9f-7908-47f9-ad48-51d2607d757d","Type":"ContainerDied","Data":"6efbf45694ad30d03214d2b25eebff922d51749726aeac11655439546c2a754e"}
Jul 23 12:56:19.707577 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.707550    2570 scope.go:117] "RemoveContainer" containerID="6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd"
Jul 23 12:56:19.709221 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.708871    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q" podUID="c368f202-99e3-419a-9edb-a9fa6f75dbd1" containerName="main" containerID="cri-o://9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b" gracePeriod=45
Jul 23 12:56:19.720282 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.719600    2570 scope.go:117] "RemoveContainer" containerID="6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd"
Jul 23 12:56:19.720798 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:56:19.720765    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd\": container with ID starting with 6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd not found: ID does not exist" containerID="6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd"
Jul 23 12:56:19.720950 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.720925    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd"} err="failed to get container status \"6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd\": rpc error: code = NotFound desc = could not find container \"6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd\": container with ID starting with 6d4b3e26c4d87ef2384c66419bd51c40c88f44f76203e9a1f7d4f2452f20b3cd not found: ID does not exist"
Jul 23 12:56:19.804641 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.804599    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"]
Jul 23 12:56:19.809167 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.809126    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d45fc5/rate-test-model-d45fc5-kserve-7f5b99bcf-9lkwh"]
Jul 23 12:56:19.968856 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:19.968825    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:56:20.063306 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063271    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tmp-dir\") pod \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") "
Jul 23 12:56:20.063542 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063319    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-model-cache\") pod \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") "
Jul 23 12:56:20.063542 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063340    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tls-certs\") pod \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") "
Jul 23 12:56:20.063542 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063439    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-home\") pod \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") "
Jul 23 12:56:20.063542 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063465    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xczmr\" (UniqueName: \"kubernetes.io/projected/c368f202-99e3-419a-9edb-a9fa6f75dbd1-kube-api-access-xczmr\") pod \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") "
Jul 23 12:56:20.063542 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063512    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-dshm\") pod \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\" (UID: \"c368f202-99e3-419a-9edb-a9fa6f75dbd1\") "
Jul 23 12:56:20.063783 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063646    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-model-cache" (OuterVolumeSpecName: "model-cache") pod "c368f202-99e3-419a-9edb-a9fa6f75dbd1" (UID: "c368f202-99e3-419a-9edb-a9fa6f75dbd1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:56:20.063783 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063678    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c368f202-99e3-419a-9edb-a9fa6f75dbd1" (UID: "c368f202-99e3-419a-9edb-a9fa6f75dbd1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:56:20.063783 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063723    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-home" (OuterVolumeSpecName: "home") pod "c368f202-99e3-419a-9edb-a9fa6f75dbd1" (UID: "c368f202-99e3-419a-9edb-a9fa6f75dbd1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:56:20.063920 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063856    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-home\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:20.063920 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063871    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tmp-dir\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:20.063920 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.063881    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-model-cache\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:20.065672 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.065639    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c368f202-99e3-419a-9edb-a9fa6f75dbd1" (UID: "c368f202-99e3-419a-9edb-a9fa6f75dbd1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 12:56:20.065672 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.065666    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c368f202-99e3-419a-9edb-a9fa6f75dbd1-kube-api-access-xczmr" (OuterVolumeSpecName: "kube-api-access-xczmr") pod "c368f202-99e3-419a-9edb-a9fa6f75dbd1" (UID: "c368f202-99e3-419a-9edb-a9fa6f75dbd1"). InnerVolumeSpecName "kube-api-access-xczmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:56:20.065822 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.065639    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-dshm" (OuterVolumeSpecName: "dshm") pod "c368f202-99e3-419a-9edb-a9fa6f75dbd1" (UID: "c368f202-99e3-419a-9edb-a9fa6f75dbd1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:56:20.164976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.164935    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xczmr\" (UniqueName: \"kubernetes.io/projected/c368f202-99e3-419a-9edb-a9fa6f75dbd1-kube-api-access-xczmr\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:20.164976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.164967    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c368f202-99e3-419a-9edb-a9fa6f75dbd1-dshm\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:20.164976 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.164977    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c368f202-99e3-419a-9edb-a9fa6f75dbd1-tls-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:20.714678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.714643    2570 generic.go:356] "Generic (PLEG): container finished" podID="c368f202-99e3-419a-9edb-a9fa6f75dbd1" containerID="9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b" exitCode=0
Jul 23 12:56:20.714678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.714685    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"
Jul 23 12:56:20.714911 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.714725    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q" event={"ID":"c368f202-99e3-419a-9edb-a9fa6f75dbd1","Type":"ContainerDied","Data":"9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b"}
Jul 23 12:56:20.714911 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.714768    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q" event={"ID":"c368f202-99e3-419a-9edb-a9fa6f75dbd1","Type":"ContainerDied","Data":"4eb0c2e754bb3710dd5b8b2b8fa5951ba251aeeab7cf6238c0f873f1b7544507"}
Jul 23 12:56:20.714911 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.714787    2570 scope.go:117] "RemoveContainer" containerID="9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b"
Jul 23 12:56:20.725268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.725250    2570 scope.go:117] "RemoveContainer" containerID="9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b"
Jul 23 12:56:20.725625 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:56:20.725605    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b\": container with ID starting with 9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b not found: ID does not exist" containerID="9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b"
Jul 23 12:56:20.725706 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.725640    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b"} err="failed to get container status \"9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b\": rpc error: code = NotFound desc = could not find container \"9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b\": container with ID starting with 9509c478de880a0294e3b85c842f11f193d8d8001a2758ddf0cdd5657a2b7a0b not found: ID does not exist"
Jul 23 12:56:20.739711 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.739678    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18659b9f-7908-47f9-ad48-51d2607d757d" path="/var/lib/kubelet/pods/18659b9f-7908-47f9-ad48-51d2607d757d/volumes"
Jul 23 12:56:20.739969 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.739954    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"]
Jul 23 12:56:20.743066 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.743035    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-474ecb/rate-test-model-474ecb-kserve-59cbdcc55f-g5v7q"]
Jul 23 12:56:20.862374 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.862346    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:20.885628 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.885598    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7583-140481949653008_e7ebedfb-099f-4f60-97c5-cf0fa406e970/test-curl-7583-140481949653008/0.log"
Jul 23 12:56:20.915818 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.915778    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:20.919827 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.919799    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:20.972462 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.972357    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwqlv\" (UniqueName: \"kubernetes.io/projected/e7ebedfb-099f-4f60-97c5-cf0fa406e970-kube-api-access-vwqlv\") pod \"e7ebedfb-099f-4f60-97c5-cf0fa406e970\" (UID: \"e7ebedfb-099f-4f60-97c5-cf0fa406e970\") "
Jul 23 12:56:20.974562 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:20.974528    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ebedfb-099f-4f60-97c5-cf0fa406e970-kube-api-access-vwqlv" (OuterVolumeSpecName: "kube-api-access-vwqlv") pod "e7ebedfb-099f-4f60-97c5-cf0fa406e970" (UID: "e7ebedfb-099f-4f60-97c5-cf0fa406e970"). InnerVolumeSpecName "kube-api-access-vwqlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:56:21.044289 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044252    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:21.044642 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044627    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ebedfb-099f-4f60-97c5-cf0fa406e970" containerName="test-curl-7583-140481949653008"
Jul 23 12:56:21.044696 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044643    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ebedfb-099f-4f60-97c5-cf0fa406e970" containerName="test-curl-7583-140481949653008"
Jul 23 12:56:21.044696 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044656    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c368f202-99e3-419a-9edb-a9fa6f75dbd1" containerName="main"
Jul 23 12:56:21.044696 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044661    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c368f202-99e3-419a-9edb-a9fa6f75dbd1" containerName="main"
Jul 23 12:56:21.044696 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044676    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18659b9f-7908-47f9-ad48-51d2607d757d" containerName="main"
Jul 23 12:56:21.044696 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044681    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="18659b9f-7908-47f9-ad48-51d2607d757d" containerName="main"
Jul 23 12:56:21.044840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044757    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c368f202-99e3-419a-9edb-a9fa6f75dbd1" containerName="main"
Jul 23 12:56:21.044840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044767    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ebedfb-099f-4f60-97c5-cf0fa406e970" containerName="test-curl-7583-140481949653008"
Jul 23 12:56:21.044840 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.044773    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="18659b9f-7908-47f9-ad48-51d2607d757d" containerName="main"
Jul 23 12:56:21.047723 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.047706    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:21.052714 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.052637    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:21.073084 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.073048    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwqlv\" (UniqueName: \"kubernetes.io/projected/e7ebedfb-099f-4f60-97c5-cf0fa406e970-kube-api-access-vwqlv\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:21.174481 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.174440    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbh2\" (UniqueName: \"kubernetes.io/projected/d8830dda-a1bd-47ec-b40c-7b5b558fddb4-kube-api-access-zkbh2\") pod \"test-curl-7583-140481949653008\" (UID: \"d8830dda-a1bd-47ec-b40c-7b5b558fddb4\") " pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:21.275977 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.275879    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbh2\" (UniqueName: \"kubernetes.io/projected/d8830dda-a1bd-47ec-b40c-7b5b558fddb4-kube-api-access-zkbh2\") pod \"test-curl-7583-140481949653008\" (UID: \"d8830dda-a1bd-47ec-b40c-7b5b558fddb4\") " pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:21.284280 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.284252    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbh2\" (UniqueName: \"kubernetes.io/projected/d8830dda-a1bd-47ec-b40c-7b5b558fddb4-kube-api-access-zkbh2\") pod \"test-curl-7583-140481949653008\" (UID: \"d8830dda-a1bd-47ec-b40c-7b5b558fddb4\") " pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:21.359053 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.358989    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:21.529991 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:56:21.529961    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8830dda_a1bd_47ec_b40c_7b5b558fddb4.slice/crio-3748564984f5a8a61980141ee290a92e15a46eca4e2ff11c3072b2b031e5e6a6 WatchSource:0}: Error finding container 3748564984f5a8a61980141ee290a92e15a46eca4e2ff11c3072b2b031e5e6a6: Status 404 returned error can't find the container with id 3748564984f5a8a61980141ee290a92e15a46eca4e2ff11c3072b2b031e5e6a6
Jul 23 12:56:21.531201 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.531173    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:21.722181 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.722145    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:21.722181 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.722179    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04b14bb403a35b329a2d843dc8a305f0350e387c40e1e988b452ca3d196f388f"
Jul 23 12:56:21.723590 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.723556    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7583-140481949653008" event={"ID":"d8830dda-a1bd-47ec-b40c-7b5b558fddb4","Type":"ContainerStarted","Data":"3748564984f5a8a61980141ee290a92e15a46eca4e2ff11c3072b2b031e5e6a6"}
Jul 23 12:56:21.735196 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:21.735154    2570 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7583-140481949653008" oldPodUID="e7ebedfb-099f-4f60-97c5-cf0fa406e970" podUID="d8830dda-a1bd-47ec-b40c-7b5b558fddb4"
Jul 23 12:56:22.731678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:22.731637    2570 generic.go:356] "Generic (PLEG): container finished" podID="d8830dda-a1bd-47ec-b40c-7b5b558fddb4" containerID="4428261fbba94d2a33453056ef5a575ba6fd6a7af8473480cefc4d94b76a2200" exitCode=0
Jul 23 12:56:22.731678 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:22.731681    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7583-140481949653008" event={"ID":"d8830dda-a1bd-47ec-b40c-7b5b558fddb4","Type":"ContainerDied","Data":"4428261fbba94d2a33453056ef5a575ba6fd6a7af8473480cefc4d94b76a2200"}
Jul 23 12:56:22.738240 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:22.738212    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c368f202-99e3-419a-9edb-a9fa6f75dbd1" path="/var/lib/kubelet/pods/c368f202-99e3-419a-9edb-a9fa6f75dbd1/volumes"
Jul 23 12:56:22.738584 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:22.738571    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7ebedfb-099f-4f60-97c5-cf0fa406e970" path="/var/lib/kubelet/pods/e7ebedfb-099f-4f60-97c5-cf0fa406e970/volumes"
Jul 23 12:56:23.886927 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:23.886898    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:23.912020 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:23.911994    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7583-140481949653008_d8830dda-a1bd-47ec-b40c-7b5b558fddb4/test-curl-7583-140481949653008/0.log"
Jul 23 12:56:23.943567 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:23.943522    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:23.948710 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:23.948674    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7583-140481949653008"]
Jul 23 12:56:24.001589 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.001445    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkbh2\" (UniqueName: \"kubernetes.io/projected/d8830dda-a1bd-47ec-b40c-7b5b558fddb4-kube-api-access-zkbh2\") pod \"d8830dda-a1bd-47ec-b40c-7b5b558fddb4\" (UID: \"d8830dda-a1bd-47ec-b40c-7b5b558fddb4\") "
Jul 23 12:56:24.003694 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.003660    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8830dda-a1bd-47ec-b40c-7b5b558fddb4-kube-api-access-zkbh2" (OuterVolumeSpecName: "kube-api-access-zkbh2") pod "d8830dda-a1bd-47ec-b40c-7b5b558fddb4" (UID: "d8830dda-a1bd-47ec-b40c-7b5b558fddb4"). InnerVolumeSpecName "kube-api-access-zkbh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:56:24.102345 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.102301    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkbh2\" (UniqueName: \"kubernetes.io/projected/d8830dda-a1bd-47ec-b40c-7b5b558fddb4-kube-api-access-zkbh2\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:24.139209 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.139152    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"]
Jul 23 12:56:24.139718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.139695    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8830dda-a1bd-47ec-b40c-7b5b558fddb4" containerName="test-curl-7583-140481949653008"
Jul 23 12:56:24.139718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.139718    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8830dda-a1bd-47ec-b40c-7b5b558fddb4" containerName="test-curl-7583-140481949653008"
Jul 23 12:56:24.139883 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.139841    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8830dda-a1bd-47ec-b40c-7b5b558fddb4" containerName="test-curl-7583-140481949653008"
Jul 23 12:56:24.142969 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.142938    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"
Jul 23 12:56:24.146132 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.146064    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ncgg\""
Jul 23 12:56:24.147134 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.146425    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 12:56:24.150073 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.150018    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"]
Jul 23 12:56:24.203139 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.203102    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ab9b56-99f3-4570-9978-51b6de0625e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc\" (UID: \"43ab9b56-99f3-4570-9978-51b6de0625e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"
Jul 23 12:56:24.304410 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.304296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ab9b56-99f3-4570-9978-51b6de0625e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc\" (UID: \"43ab9b56-99f3-4570-9978-51b6de0625e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"
Jul 23 12:56:24.305016 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.304994    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ab9b56-99f3-4570-9978-51b6de0625e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc\" (UID: \"43ab9b56-99f3-4570-9978-51b6de0625e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"
Jul 23 12:56:24.456357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.456312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"
Jul 23 12:56:24.598393 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.598367    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"]
Jul 23 12:56:24.600217 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:56:24.600188    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ab9b56_99f3_4570_9978_51b6de0625e1.slice/crio-a5fd401dec57e9068a126ea6e2c92dfc06958f34311921a0351c6ddcbdc42852 WatchSource:0}: Error finding container a5fd401dec57e9068a126ea6e2c92dfc06958f34311921a0351c6ddcbdc42852: Status 404 returned error can't find the container with id a5fd401dec57e9068a126ea6e2c92dfc06958f34311921a0351c6ddcbdc42852
Jul 23 12:56:24.740308 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.740274    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8830dda-a1bd-47ec-b40c-7b5b558fddb4" path="/var/lib/kubelet/pods/d8830dda-a1bd-47ec-b40c-7b5b558fddb4/volumes"
Jul 23 12:56:24.744034 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.744005    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7583-140481949653008"
Jul 23 12:56:24.744190 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.744044    2570 scope.go:117] "RemoveContainer" containerID="4428261fbba94d2a33453056ef5a575ba6fd6a7af8473480cefc4d94b76a2200"
Jul 23 12:56:24.745586 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.745560    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc" event={"ID":"43ab9b56-99f3-4570-9978-51b6de0625e1","Type":"ContainerStarted","Data":"a5fd401dec57e9068a126ea6e2c92dfc06958f34311921a0351c6ddcbdc42852"}
Jul 23 12:56:24.793236 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.793198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:24.894144 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:24.894036    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:25.753923 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:25.753892    2570 generic.go:356] "Generic (PLEG): container finished" podID="43ab9b56-99f3-4570-9978-51b6de0625e1" containerID="6b7d7b7b4d5257140c740f42224bd740c99a7d559590442504e9008d5ca11a1f" exitCode=0
Jul 23 12:56:25.754122 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:25.753980    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc" event={"ID":"43ab9b56-99f3-4570-9978-51b6de0625e1","Type":"ContainerDied","Data":"6b7d7b7b4d5257140c740f42224bd740c99a7d559590442504e9008d5ca11a1f"}
Jul 23 12:56:26.908171 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:26.908147    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"
Jul 23 12:56:27.031882 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:27.031788    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ab9b56-99f3-4570-9978-51b6de0625e1-maas-api-service-ca\") pod \"43ab9b56-99f3-4570-9978-51b6de0625e1\" (UID: \"43ab9b56-99f3-4570-9978-51b6de0625e1\") "
Jul 23 12:56:27.032189 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:27.032164    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ab9b56-99f3-4570-9978-51b6de0625e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43ab9b56-99f3-4570-9978-51b6de0625e1" (UID: "43ab9b56-99f3-4570-9978-51b6de0625e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:56:27.132725 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:27.132682    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43ab9b56-99f3-4570-9978-51b6de0625e1-maas-api-service-ca\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:56:27.767386 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:27.767350    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"
Jul 23 12:56:27.767599 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:27.767388    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc" event={"ID":"43ab9b56-99f3-4570-9978-51b6de0625e1","Type":"ContainerDied","Data":"a5fd401dec57e9068a126ea6e2c92dfc06958f34311921a0351c6ddcbdc42852"}
Jul 23 12:56:27.767599 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:27.767441    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5fd401dec57e9068a126ea6e2c92dfc06958f34311921a0351c6ddcbdc42852"
Jul 23 12:56:34.611010 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:34.610965    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:39.213377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:39.213335    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:39.227731 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:39.227697    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"]
Jul 23 12:56:39.230143 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:39.230112    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d45fc5-jtnvc"]
Jul 23 12:56:39.898078 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:39.898025    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:40.738850 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:40.738810    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43ab9b56-99f3-4570-9978-51b6de0625e1" path="/var/lib/kubelet/pods/43ab9b56-99f3-4570-9978-51b6de0625e1/volumes"
Jul 23 12:56:45.933530 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:45.933485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:45.996754 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:45.996715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:46.233835 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:46.233801    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:46.469276 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:46.469228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:47.173516 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:47.173479    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:47.592404 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:47.592346    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:56:57.260462 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:56:57.260430    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:57:01.671203 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:01.671151    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:57:02.363095 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:02.363032    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:57:08.488911 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:08.488874    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:57:08.542125 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:08.542087    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:57:08.748831 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:08.748734    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"]
Jul 23 12:57:08.749018 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:08.748973    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy" containerID="cri-o://07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d" gracePeriod=30
Jul 23 12:57:08.768938 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:08.768904    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:57:09.009457 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:09.009356    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:57:09.453165 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:09.453073    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-584d8d7597-g75xm_d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb/authorino/0.log"
Jul 23 12:57:12.513895 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:12.513854    2570 patch_prober.go:28] interesting pod/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 12:57:12.514374 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:12.513913    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 12:57:14.009558 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.009460    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:57:14.020887 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.020851    2570 generic.go:356] "Generic (PLEG): container finished" podID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerID="07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d" exitCode=0
Jul 23 12:57:14.021071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.020907    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"
Jul 23 12:57:14.021071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.020906    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" event={"ID":"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae","Type":"ContainerDied","Data":"07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d"}
Jul 23 12:57:14.021071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.021032    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75" event={"ID":"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae","Type":"ContainerDied","Data":"28cd7133e3e015eaa5abffcaab48f5a312b044e1671200c45246223e943266b1"}
Jul 23 12:57:14.021071 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.021056    2570 scope.go:117] "RemoveContainer" containerID="07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d"
Jul 23 12:57:14.031305 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.031254    2570 scope.go:117] "RemoveContainer" containerID="3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca"
Jul 23 12:57:14.042113 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.042086    2570 scope.go:117] "RemoveContainer" containerID="07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d"
Jul 23 12:57:14.042506 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:57:14.042453    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d\": container with ID starting with 07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d not found: ID does not exist" containerID="07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d"
Jul 23 12:57:14.042599 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.042515    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d"} err="failed to get container status \"07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d\": rpc error: code = NotFound desc = could not find container \"07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d\": container with ID starting with 07a32d36a5c34f3b16cc4318fd447183b12474afd2cffae3e522e760fa14cb3d not found: ID does not exist"
Jul 23 12:57:14.042599 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.042536    2570 scope.go:117] "RemoveContainer" containerID="3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca"
Jul 23 12:57:14.042823 ip-10-0-133-105 kubenswrapper[2570]: E0723 12:57:14.042807    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca\": container with ID starting with 3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca not found: ID does not exist" containerID="3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca"
Jul 23 12:57:14.042868 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.042828    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca"} err="failed to get container status \"3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca\": rpc error: code = NotFound desc = could not find container \"3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca\": container with ID starting with 3ac0c5a2df7b5fcf7ad769887383f0f464a24aa4b49ec69cc49e1c1f6c4fe2ca not found: ID does not exist"
Jul 23 12:57:14.189821 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.189784    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-envoy\") pod \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") "
Jul 23 12:57:14.189821 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.189836    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-credential-socket\") pod \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") "
Jul 23 12:57:14.190157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.189862    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppwsp\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-kube-api-access-ppwsp\") pod \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") "
Jul 23 12:57:14.190157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.189897    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-data\") pod \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") "
Jul 23 12:57:14.190157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.189923    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-certs\") pod \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") "
Jul 23 12:57:14.190157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.189950    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istiod-ca-cert\") pod \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") "
Jul 23 12:57:14.190157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.190013    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-token\") pod \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") "
Jul 23 12:57:14.190157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.190061    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-podinfo\") pod \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") "
Jul 23 12:57:14.190157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.190095    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" (UID: "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:57:14.190157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.190132    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-socket\") pod \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\" (UID: \"3d3070c6-f75b-4a8f-8661-cb289fb2a1ae\") "
Jul 23 12:57:14.190606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.190303    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" (UID: "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:57:14.190606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.190453    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" (UID: "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:57:14.190606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.190464    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-credential-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:57:14.190606 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.190584    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-certs\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:57:14.190820 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.190754    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" (UID: "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:57:14.191518 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.191458    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" (UID: "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:57:14.192363 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.192339    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" (UID: "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:57:14.192482 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.192364    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-kube-api-access-ppwsp" (OuterVolumeSpecName: "kube-api-access-ppwsp") pod "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" (UID: "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae"). InnerVolumeSpecName "kube-api-access-ppwsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:57:14.192482 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.192382    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" (UID: "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:57:14.192482 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.192436    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" (UID: "3d3070c6-f75b-4a8f-8661-cb289fb2a1ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 12:57:14.291377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.291278    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-token\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:57:14.291377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.291313    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-podinfo\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:57:14.291377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.291324    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-workload-socket\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:57:14.291377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.291334    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-envoy\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:57:14.291377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.291342    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppwsp\" (UniqueName: \"kubernetes.io/projected/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-kube-api-access-ppwsp\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:57:14.291377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.291352    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istio-data\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:57:14.291377 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.291366    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae-istiod-ca-cert\") on node \"ip-10-0-133-105.ec2.internal\" DevicePath \"\""
Jul 23 12:57:14.344263 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.344218    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"]
Jul 23 12:57:14.350718 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.350685    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-474ecb-openshift-default-597cf478cf-s8d75"]
Jul 23 12:57:14.738812 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:14.738778    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" path="/var/lib/kubelet/pods/3d3070c6-f75b-4a8f-8661-cb289fb2a1ae/volumes"
Jul 23 12:57:15.605569 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:15.605537    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-drxt9_2a90a635-239c-4ab3-9fb9-eb9bbbdfe674/manager/0.log"
Jul 23 12:57:15.893941 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:15.893856    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c_36d83901-3b86-4e99-bd88-48e62e4524f0/copy-manifests/0.log"
Jul 23 12:57:15.900724 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:15.900693    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c_36d83901-3b86-4e99-bd88-48e62e4524f0/manager/0.log"
Jul 23 12:57:16.628753 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:16.628722    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746845-lmj2h_81fc275b-8601-405c-afda-86964db5c4e5/cleanup/0.log"
Jul 23 12:57:17.606962 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:17.606926    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c_852f4294-9e61-4f11-a6b2-dd21c4949ebf/util/0.log"
Jul 23 12:57:17.614003 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:17.613964    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c_852f4294-9e61-4f11-a6b2-dd21c4949ebf/pull/0.log"
Jul 23 12:57:17.620807 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:17.620786    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c_852f4294-9e61-4f11-a6b2-dd21c4949ebf/extract/0.log"
Jul 23 12:57:17.747372 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:17.747337    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm_3a03ae2b-ecca-4971-92f3-693087b948aa/pull/0.log"
Jul 23 12:57:17.755438 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:17.755410    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm_3a03ae2b-ecca-4971-92f3-693087b948aa/extract/0.log"
Jul 23 12:57:17.763086 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:17.763052    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm_3a03ae2b-ecca-4971-92f3-693087b948aa/util/0.log"
Jul 23 12:57:17.883076 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:17.882976    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w_56836c27-6df4-4c95-82dd-700ff9099282/util/0.log"
Jul 23 12:57:17.892336 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:17.892302    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w_56836c27-6df4-4c95-82dd-700ff9099282/pull/0.log"
Jul 23 12:57:17.899381 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:17.899358    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w_56836c27-6df4-4c95-82dd-700ff9099282/extract/0.log"
Jul 23 12:57:18.020683 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:18.020658    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n_d67476ef-9729-4675-bc05-e8ab0f0c6100/util/0.log"
Jul 23 12:57:18.028538 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:18.028509    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n_d67476ef-9729-4675-bc05-e8ab0f0c6100/pull/0.log"
Jul 23 12:57:18.035734 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:18.035710    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n_d67476ef-9729-4675-bc05-e8ab0f0c6100/extract/0.log"
Jul 23 12:57:18.157157 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:18.157041    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-584d8d7597-g75xm_d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb/authorino/0.log"
Jul 23 12:57:19.399666 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:19.399626    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jkwzp_ba9cab71-5475-465c-ab5b-aa75d55c5056/istio-proxy/0.log"
Jul 23 12:57:19.763698 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:19.763656    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7c78d7c4-z4k9x_4c25e735-4666-4a1e-afdc-e8cb1b0015cb/kube-auth-proxy/0.log"
Jul 23 12:57:20.004399 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:20.004366    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-wcnbm_35b30179-caec-428c-b4a9-0df94aefe918/payload-pre-processing/0.log"
Jul 23 12:57:20.261103 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:20.261075    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7446c55b64-2xtn9_365a7b42-7e90-4da9-84d0-8546d85da537/router/0.log"
Jul 23 12:57:20.624007 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:20.623905    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vm2fk_4fcbe907-5ede-401e-a14f-b929b1cc3d7c/main/0.log"
Jul 23 12:57:21.227047 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:21.227006    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-khnpq_f58388c4-a607-43bf-bad0-766a6ac251c9/main/0.log"
Jul 23 12:57:26.688703 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.688651    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jmcfw/must-gather-q4j2d"]
Jul 23 12:57:26.689268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.689243    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy"
Jul 23 12:57:26.689357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.689272    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy"
Jul 23 12:57:26.689357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.689299    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ab9b56-99f3-4570-9978-51b6de0625e1" containerName="revoke-keys"
Jul 23 12:57:26.689357 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.689308    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ab9b56-99f3-4570-9978-51b6de0625e1" containerName="revoke-keys"
Jul 23 12:57:26.689549 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.689425    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="43ab9b56-99f3-4570-9978-51b6de0625e1" containerName="revoke-keys"
Jul 23 12:57:26.689549 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.689440    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy"
Jul 23 12:57:26.689549 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.689451    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy"
Jul 23 12:57:26.689702 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.689561    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy"
Jul 23 12:57:26.689702 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.689573    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3070c6-f75b-4a8f-8661-cb289fb2a1ae" containerName="istio-proxy"
Jul 23 12:57:26.694278 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.694249    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jmcfw/must-gather-q4j2d"
Jul 23 12:57:26.696764 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.696739    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jmcfw\"/\"openshift-service-ca.crt\""
Jul 23 12:57:26.696934 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.696783    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jmcfw\"/\"kube-root-ca.crt\""
Jul 23 12:57:26.697489 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.697457    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jmcfw\"/\"default-dockercfg-v244z\""
Jul 23 12:57:26.700958 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.700932    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:57:26.701439 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.701413    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jmcfw/must-gather-q4j2d"]
Jul 23 12:57:26.798317 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.798286    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log" limit=1024
Jul 23 12:57:26.810580 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.810543    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1d58e038-6be0-4eb3-a4f9-3f00f983c274-must-gather-output\") pod \"must-gather-q4j2d\" (UID: \"1d58e038-6be0-4eb3-a4f9-3f00f983c274\") " pod="openshift-must-gather-jmcfw/must-gather-q4j2d"
Jul 23 12:57:26.810744 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.810591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd69w\" (UniqueName: \"kubernetes.io/projected/1d58e038-6be0-4eb3-a4f9-3f00f983c274-kube-api-access-nd69w\") pod \"must-gather-q4j2d\" (UID: \"1d58e038-6be0-4eb3-a4f9-3f00f983c274\") " pod="openshift-must-gather-jmcfw/must-gather-q4j2d"
Jul 23 12:57:26.911239 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.911195    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1d58e038-6be0-4eb3-a4f9-3f00f983c274-must-gather-output\") pod \"must-gather-q4j2d\" (UID: \"1d58e038-6be0-4eb3-a4f9-3f00f983c274\") " pod="openshift-must-gather-jmcfw/must-gather-q4j2d"
Jul 23 12:57:26.911239 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.911247    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd69w\" (UniqueName: \"kubernetes.io/projected/1d58e038-6be0-4eb3-a4f9-3f00f983c274-kube-api-access-nd69w\") pod \"must-gather-q4j2d\" (UID: \"1d58e038-6be0-4eb3-a4f9-3f00f983c274\") " pod="openshift-must-gather-jmcfw/must-gather-q4j2d"
Jul 23 12:57:26.911615 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.911593    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1d58e038-6be0-4eb3-a4f9-3f00f983c274-must-gather-output\") pod \"must-gather-q4j2d\" (UID: \"1d58e038-6be0-4eb3-a4f9-3f00f983c274\") " pod="openshift-must-gather-jmcfw/must-gather-q4j2d"
Jul 23 12:57:26.922434 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:26.922397    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd69w\" (UniqueName: \"kubernetes.io/projected/1d58e038-6be0-4eb3-a4f9-3f00f983c274-kube-api-access-nd69w\") pod \"must-gather-q4j2d\" (UID: \"1d58e038-6be0-4eb3-a4f9-3f00f983c274\") " pod="openshift-must-gather-jmcfw/must-gather-q4j2d"
Jul 23 12:57:27.004644 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:27.004600    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jmcfw/must-gather-q4j2d"
Jul 23 12:57:27.151491 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:27.151446    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jmcfw/must-gather-q4j2d"]
Jul 23 12:57:27.153819 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:57:27.153790    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d58e038_6be0_4eb3_a4f9_3f00f983c274.slice/crio-29bc9fd9edee104449c99c52b506aa93f0e9a788290fc1a24e993cf4b1caac1a WatchSource:0}: Error finding container 29bc9fd9edee104449c99c52b506aa93f0e9a788290fc1a24e993cf4b1caac1a: Status 404 returned error can't find the container with id 29bc9fd9edee104449c99c52b506aa93f0e9a788290fc1a24e993cf4b1caac1a
Jul 23 12:57:28.098768 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:28.098731    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jmcfw/must-gather-q4j2d" event={"ID":"1d58e038-6be0-4eb3-a4f9-3f00f983c274","Type":"ContainerStarted","Data":"29bc9fd9edee104449c99c52b506aa93f0e9a788290fc1a24e993cf4b1caac1a"}
Jul 23 12:57:29.109097 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:29.109045    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jmcfw/must-gather-q4j2d" event={"ID":"1d58e038-6be0-4eb3-a4f9-3f00f983c274","Type":"ContainerStarted","Data":"d4af76148a85f4813168a70e94fd56f9e6cf573fb41a95eaeb5d59d9b6550a24"}
Jul 23 12:57:29.109846 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:29.109814    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jmcfw/must-gather-q4j2d" event={"ID":"1d58e038-6be0-4eb3-a4f9-3f00f983c274","Type":"ContainerStarted","Data":"2e79308b37991fd3755e74294a094bb2fc24c6669cb223608a5b5b7aa86110b7"}
Jul 23 12:57:29.129391 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:29.129316    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jmcfw/must-gather-q4j2d" podStartSLOduration=2.246122769 podStartE2EDuration="3.129293224s" totalImagesPullingTime="883.170455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:57:29.127232852 +0000 UTC m=+2850.888352204" watchObservedRunningTime="2026-07-23 12:57:29.129293224 +0000 UTC m=+2850.890412577"
Jul 23 12:57:29.762681 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:29.762645    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nhxhc_2fa7e528-7695-4a0e-a325-956ff07acf09/global-pull-secret-syncer/0.log"
Jul 23 12:57:29.860129 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:29.860091    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4jmxz_252ff8de-6507-4855-adda-acef49b9eec4/konnectivity-agent/0.log"
Jul 23 12:57:29.950604 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:29.950538    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-105.ec2.internal_e4e9942b1aad18340678b6e6d4966a0e/haproxy/0.log"
Jul 23 12:57:34.743918 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.743865    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c_852f4294-9e61-4f11-a6b2-dd21c4949ebf/extract/0.log"
Jul 23 12:57:34.767517 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.767459    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c_852f4294-9e61-4f11-a6b2-dd21c4949ebf/util/0.log"
Jul 23 12:57:34.794510 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.794459    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w2t6c_852f4294-9e61-4f11-a6b2-dd21c4949ebf/pull/0.log"
Jul 23 12:57:34.828901 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.828865    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm_3a03ae2b-ecca-4971-92f3-693087b948aa/extract/0.log"
Jul 23 12:57:34.857549 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.857518    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm_3a03ae2b-ecca-4971-92f3-693087b948aa/util/0.log"
Jul 23 12:57:34.881286 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.881253    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gh5mm_3a03ae2b-ecca-4971-92f3-693087b948aa/pull/0.log"
Jul 23 12:57:34.915730 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.915693    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w_56836c27-6df4-4c95-82dd-700ff9099282/extract/0.log"
Jul 23 12:57:34.939371 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.939342    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w_56836c27-6df4-4c95-82dd-700ff9099282/util/0.log"
Jul 23 12:57:34.963782 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.963740    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73th49w_56836c27-6df4-4c95-82dd-700ff9099282/pull/0.log"
Jul 23 12:57:34.993378 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:34.993341    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n_d67476ef-9729-4675-bc05-e8ab0f0c6100/extract/0.log"
Jul 23 12:57:35.018669 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:35.018578    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n_d67476ef-9729-4675-bc05-e8ab0f0c6100/util/0.log"
Jul 23 12:57:35.052200 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:35.052144    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q7j9n_d67476ef-9729-4675-bc05-e8ab0f0c6100/pull/0.log"
Jul 23 12:57:35.532393 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:35.532341    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-584d8d7597-g75xm_d6ffbc7c-4d1b-486e-bafa-71fa9cc939fb/authorino/0.log"
Jul 23 12:57:37.654313 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:37.654205    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d69aa25d-b39f-45a7-a0fd-0e24c883acc4/alertmanager/0.log"
Jul 23 12:57:37.690462 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:37.690389    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d69aa25d-b39f-45a7-a0fd-0e24c883acc4/config-reloader/0.log"
Jul 23 12:57:37.717035 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:37.717006    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d69aa25d-b39f-45a7-a0fd-0e24c883acc4/kube-rbac-proxy-web/0.log"
Jul 23 12:57:37.747270 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:37.747242    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d69aa25d-b39f-45a7-a0fd-0e24c883acc4/kube-rbac-proxy/0.log"
Jul 23 12:57:37.773092 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:37.773050    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d69aa25d-b39f-45a7-a0fd-0e24c883acc4/kube-rbac-proxy-metric/0.log"
Jul 23 12:57:37.796715 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:37.796686    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d69aa25d-b39f-45a7-a0fd-0e24c883acc4/prom-label-proxy/0.log"
Jul 23 12:57:37.824110 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:37.824079    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d69aa25d-b39f-45a7-a0fd-0e24c883acc4/init-config-reloader/0.log"
Jul 23 12:57:37.869069 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:37.868917    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-d7nq5_7709b281-8fb5-44e2-a2db-e8a5d50505cb/cluster-monitoring-operator/0.log"
Jul 23 12:57:38.225686 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.225661    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t6rfc_231a8367-faaa-47c9-a74b-eea995b30ddb/node-exporter/0.log"
Jul 23 12:57:38.248626 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.248591    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t6rfc_231a8367-faaa-47c9-a74b-eea995b30ddb/kube-rbac-proxy/0.log"
Jul 23 12:57:38.272778 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.272746    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t6rfc_231a8367-faaa-47c9-a74b-eea995b30ddb/init-textfile/0.log"
Jul 23 12:57:38.598849 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.598807    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-zfjv2_4717611e-3b71-41f1-b44b-f0252e12e4da/prometheus-operator/0.log"
Jul 23 12:57:38.620711 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.620678    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-zfjv2_4717611e-3b71-41f1-b44b-f0252e12e4da/kube-rbac-proxy/0.log"
Jul 23 12:57:38.767358 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.767265    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-95f4b9bcf-twrwl_b4b98f03-ec22-4a68-b05e-88ef74fbe38f/thanos-query/0.log"
Jul 23 12:57:38.791209 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.791176    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-95f4b9bcf-twrwl_b4b98f03-ec22-4a68-b05e-88ef74fbe38f/kube-rbac-proxy-web/0.log"
Jul 23 12:57:38.816844 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.816818    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-95f4b9bcf-twrwl_b4b98f03-ec22-4a68-b05e-88ef74fbe38f/kube-rbac-proxy/0.log"
Jul 23 12:57:38.840565 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.840536    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-95f4b9bcf-twrwl_b4b98f03-ec22-4a68-b05e-88ef74fbe38f/prom-label-proxy/0.log"
Jul 23 12:57:38.868879 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.868847    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-95f4b9bcf-twrwl_b4b98f03-ec22-4a68-b05e-88ef74fbe38f/kube-rbac-proxy-rules/0.log"
Jul 23 12:57:38.891645 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:38.891585    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-95f4b9bcf-twrwl_b4b98f03-ec22-4a68-b05e-88ef74fbe38f/kube-rbac-proxy-metrics/0.log"
Jul 23 12:57:40.287232 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.287192    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"]
Jul 23 12:57:40.295448 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.295415    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.300843 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.300811    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"]
Jul 23 12:57:40.460763 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.460726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-podres\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.461057 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.461039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-lib-modules\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.461207 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.461190    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-sys\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.461331 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.461318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p58r7\" (UniqueName: \"kubernetes.io/projected/6537d306-2bdb-4b78-930c-b79f270217a1-kube-api-access-p58r7\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.461483 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.461453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-proc\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.563146 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.563044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-podres\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.563146 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.563121    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-lib-modules\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.563392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.563155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-sys\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.563392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.563201    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p58r7\" (UniqueName: \"kubernetes.io/projected/6537d306-2bdb-4b78-930c-b79f270217a1-kube-api-access-p58r7\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.563392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.563237    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-proc\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.563392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.563285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-sys\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.563392 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.563237    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-podres\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.563676 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.563395    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-proc\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.563676 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.563404    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6537d306-2bdb-4b78-930c-b79f270217a1-lib-modules\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.573279 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.573241    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p58r7\" (UniqueName: \"kubernetes.io/projected/6537d306-2bdb-4b78-930c-b79f270217a1-kube-api-access-p58r7\") pod \"perf-node-gather-daemonset-zz9bq\" (UID: \"6537d306-2bdb-4b78-930c-b79f270217a1\") " pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.608781 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.608738    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:40.781561 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.781529    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/1.log"
Jul 23 12:57:40.789120 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.789090    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-b2ccs_ec546b3e-11ce-42a8-9482-a9103f11490d/console-operator/2.log"
Jul 23 12:57:40.799084 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:40.798984    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"]
Jul 23 12:57:40.803556 ip-10-0-133-105 kubenswrapper[2570]: W0723 12:57:40.803526    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6537d306_2bdb_4b78_930c_b79f270217a1.slice/crio-31952d0c07a3704652f564fb604b2c6ba2ca7421248f7d8d76c031eddb653f5b WatchSource:0}: Error finding container 31952d0c07a3704652f564fb604b2c6ba2ca7421248f7d8d76c031eddb653f5b: Status 404 returned error can't find the container with id 31952d0c07a3704652f564fb604b2c6ba2ca7421248f7d8d76c031eddb653f5b
Jul 23 12:57:41.217426 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:41.217385    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq" event={"ID":"6537d306-2bdb-4b78-930c-b79f270217a1","Type":"ContainerStarted","Data":"0717813e31630f8303b6e7d93b35383f6c13eceb830afbc409a17ac839701ff5"}
Jul 23 12:57:41.217652 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:41.217456    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq" event={"ID":"6537d306-2bdb-4b78-930c-b79f270217a1","Type":"ContainerStarted","Data":"31952d0c07a3704652f564fb604b2c6ba2ca7421248f7d8d76c031eddb653f5b"}
Jul 23 12:57:41.217652 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:41.217517    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:41.235373 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:41.235308    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq" podStartSLOduration=1.235286076 podStartE2EDuration="1.235286076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:57:41.231955516 +0000 UTC m=+2862.993074868" watchObservedRunningTime="2026-07-23 12:57:41.235286076 +0000 UTC m=+2862.996405424"
Jul 23 12:57:43.064068 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:43.064037    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6h9pt_a8f481be-e4e0-45c9-8234-fa269d200260/dns/0.log"
Jul 23 12:57:43.086758 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:43.086727    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6h9pt_a8f481be-e4e0-45c9-8234-fa269d200260/kube-rbac-proxy/0.log"
Jul 23 12:57:43.186868 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:43.186828    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kc8fn_26244712-6672-4444-b78f-55028760ff77/dns-node-resolver/0.log"
Jul 23 12:57:43.755449 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:43.755412    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-765cd699df-bdpfl_9ed25b61-c5c2-441b-bbf4-a8eedff5f6a1/registry/0.log"
Jul 23 12:57:43.805502 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:43.805455    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h4dhk_2b38bd05-2ec3-4078-82eb-00b3d5d6d688/node-ca/0.log"
Jul 23 12:57:44.956332 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:44.956301    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jkwzp_ba9cab71-5475-465c-ab5b-aa75d55c5056/istio-proxy/0.log"
Jul 23 12:57:45.126879 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:45.126851    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7c78d7c4-z4k9x_4c25e735-4666-4a1e-afdc-e8cb1b0015cb/kube-auth-proxy/0.log"
Jul 23 12:57:45.219773 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:45.219747    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-wcnbm_35b30179-caec-428c-b4a9-0df94aefe918/payload-pre-processing/0.log"
Jul 23 12:57:45.272619 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:45.272598    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7446c55b64-2xtn9_365a7b42-7e90-4da9-84d0-8546d85da537/router/0.log"
Jul 23 12:57:45.970527 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:45.970482    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5xlxv_9dae6922-ec15-490b-be22-96434e7dfd79/serve-healthcheck-canary/0.log"
Jul 23 12:57:46.604900 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:46.604862    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pd9r4_d9a392ff-04c5-4877-8217-0cb6622a71b5/kube-rbac-proxy/0.log"
Jul 23 12:57:46.627896 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:46.627867    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pd9r4_d9a392ff-04c5-4877-8217-0cb6622a71b5/exporter/0.log"
Jul 23 12:57:46.652635 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:46.652604    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pd9r4_d9a392ff-04c5-4877-8217-0cb6622a71b5/extractor/0.log"
Jul 23 12:57:47.237162 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:47.237126    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jmcfw/perf-node-gather-daemonset-zz9bq"
Jul 23 12:57:49.378949 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:49.378914    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-drxt9_2a90a635-239c-4ab3-9fb9-eb9bbbdfe674/manager/0.log"
Jul 23 12:57:49.513233 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:49.513154    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c_36d83901-3b86-4e99-bd88-48e62e4524f0/manager/0.log"
Jul 23 12:57:49.541033 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:49.541001    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6ddd8c6d-vp42c_36d83901-3b86-4e99-bd88-48e62e4524f0/copy-manifests/0.log"
Jul 23 12:57:50.765557 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:50.765458    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jkwzp_ba9cab71-5475-465c-ab5b-aa75d55c5056/istio-proxy/0.log"
Jul 23 12:57:50.909907 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:50.909879    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7c78d7c4-z4k9x_4c25e735-4666-4a1e-afdc-e8cb1b0015cb/kube-auth-proxy/0.log"
Jul 23 12:57:50.925520 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:50.925465    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c76dc7d5f-5j2vr_b786ce42-a908-4e8e-b7c5-f48372fb9799/manager/0.log"
Jul 23 12:57:50.981043 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:50.981010    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-wcnbm_35b30179-caec-428c-b4a9-0df94aefe918/payload-pre-processing/0.log"
Jul 23 12:57:51.015268 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:51.015241    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7446c55b64-2xtn9_365a7b42-7e90-4da9-84d0-8546d85da537/router/0.log"
Jul 23 12:57:52.302658 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:52.302634    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jkwzp_ba9cab71-5475-465c-ab5b-aa75d55c5056/istio-proxy/0.log"
Jul 23 12:57:52.442773 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:52.442742    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7c78d7c4-z4k9x_4c25e735-4666-4a1e-afdc-e8cb1b0015cb/kube-auth-proxy/0.log"
Jul 23 12:57:52.515363 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:52.515332    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-wcnbm_35b30179-caec-428c-b4a9-0df94aefe918/payload-pre-processing/0.log"
Jul 23 12:57:52.549175 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:52.549145    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7446c55b64-2xtn9_365a7b42-7e90-4da9-84d0-8546d85da537/router/0.log"
Jul 23 12:57:57.455269 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:57.455192    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcc2t_52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849/kube-multus-additional-cni-plugins/0.log"
Jul 23 12:57:57.479200 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:57.479171    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcc2t_52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849/egress-router-binary-copy/0.log"
Jul 23 12:57:57.501804 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:57.501770    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcc2t_52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849/cni-plugins/0.log"
Jul 23 12:57:57.524427 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:57.524398    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcc2t_52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849/bond-cni-plugin/0.log"
Jul 23 12:57:57.547921 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:57.547894    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcc2t_52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849/routeoverride-cni/0.log"
Jul 23 12:57:57.571510 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:57.571486    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcc2t_52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849/whereabouts-cni-bincopy/0.log"
Jul 23 12:57:57.594020 ip-10-0-133-105 kubenswrapper[2570]: I0723 12:57:57.593996    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcc2t_52ff6ab8-1ad4-4d2f-a6ea-b6fe1ec03849/whereabouts-cni/0.log"